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J10IXURXIYL AN1.IJI VINOYONO 

ma &L±fttir, mu*m 

mw% . * ,a^5F» n . 

w-n axe tg,si£#gm*4^),(» 

(imvtmz ji-n ax® w»w$wtabi axe gg, 

—A computer program is said to learn from 
experience E with respect to some class of tasks T and performance measure 
P, if its performance at tasks in T,as measured by P, improves with experience 
E. 

znm 4. 

EftAXEglM 

1.2 A3SE3K 

1-2.1 ^TC-^l^l&SJjUsU^S. 

bk 20 M 50 

• 2 • 



® i &/m ife 


S&-I20 M 50 W+IH-U 60 ^t+Hf ,&^&t#!±50F&“#^ 

.iia*$'etnw s a # 

Samuet |ftT$f§J?, WA7£2 j£SXM£ 

A^llttff^o 

20 tt£*E 60 W^R+PJ 70 ^ft+nf-.a^JHiSSF^JKF# 

^WtMWaA^ISgEM.^lifrSMiMJiiiaifUSKStA^^Mal 

was -M.a#*SEJP«+^cfe^PJHM AteM, HilfcW& A 

*. Hayes-Roth ft Winson 

20 ttt*E 70 W^R+PJ 80 WtBf .#AMA0}$o 

fa], Afim^ mpj ^ ^ m w# g % u 

A®o litln .f/ltl^AlifF#nf#PJ7 AilfftJSffio Strategic Analysis and Infor¬ 
mation System = ft**, 1984 * 

Simon^ 20 Machine Learning 3t#lHzl# 

tbUS* Machine Learning 

&-Gfraf^ttWlf££ Mostow W&^S^Lenat ftft3*«E£ 
£UfiJ¥, Langley M BACON &&&#&.&&&. 
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m AX® . £3ifc foX& E & 


2010 

Leslie valliant «[«, —Jft^ATflR^ififHiEflft 

(Probably Approximate Correct,PAC)^ JJI!i£;2011 Alin 

Judea Pearll A*£T WMMi+AJI 

¥3ft^£aAX®IBMjfc£,£AX®f&l^|jSTn2M&j8.#JfflAifi+ 


^l 6 ABJ«*S ; 5 *^r“SIB ,, W- > NS*. «l#^^WW^± 5 ^*W 3 HW 
% Aig: 3 , xfiii 


% m® a tfi*ij: AMMTf/i»-g wm .«w^x^- 


A«Btt J&, &*M,E M&ig X $%£# w* w > ^mm M 

XliMo 
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Ross Quinlan ^ Shannon ’Mitt 7 ID3 W'feo 

1984 ^ I. Kononenko.E. Roskar fH L Bratko %E ID3 JI&lKStfilli JiSIlH T AS- 
SISTANT Algorithm.I^¥.A- Hart 
ntBTChi-squa 

rl'jlo 1984 L. Breiman^C. Ttone.R. Olshen J. Freidman Hib 

1993 *{7 Quinlan# ID3 

±«ai7-#aaEHcfe,BP C4 .5 *cgf. C4 .5 mmmj id3 wiwj 

fko 

2010 ^ xie^ 

Hl-ft CART |p]* X,Y 

miffk, cart mkiiivmmitftM&m’ 

cart 

2007 

mi, suq *an wtjh*#**, «# 

J.ll^dt*S!/J'Wz:xft»W. suq mkftVf&W fcM 

fl£SLIQ|7&f7M7f£M±#M 


©FRIEDMAN B L.O R.STONE C. Classification and Regression Trees[M], San Francisco 
Wadsworth, 1984. 

©QUINLAN J R. C4. 5: programs for maChine learning[M], San Francisco: Morgan Kauff¬ 
man. 1993. 
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2000 ^ Rajeev RaSto PUBLIC 1$y£( Pruning and Building 

Integrated in Classification) H 

utikmMo 

n&&*W£tB. zhang, j ^ 2014 

X^fittUMtfcftlffe.Wang. R £ 2015 ^Stfi 

SJ3 5 . 

tT^fPSliWW^rfe. 

®£»fit«±.Parkhurst RF BF&7fc>fcaHttf&«-5£flME 

Smith RF 3^aimii^jR|gaftTW^,#fn^J»J^«f* 
mrtts. Alonso 

©££&^±,Gislasoii#flJM RF 

RF Jan flT RF ft! Logistic &M 

rf Logistic mm. 

®&E^±, Lee ^Sjfljffl RF CT § 3l&ft, 

|W|ftt&& RF ^JjflAJ CAC» 

®*Jftf£#Jfc.Dia*,Uriate RF MIffiSiPJJ. Chen ft Liu 

mm rf&ai mTw&mmK£%mn* 

©MliJlfe»±.PaLHam,Gislason^^^flJffl RF #£#2£f?TiB 

«®F£. itk^,^lfe«BFlfe#Pjr&®f^,in BartftlRFJfltffl^#^^ 

RF Logistic M;Xie 

RF * M'FrT m #ft*fa-,#HIBft&F>tif£ %M it ftT%PM£m 
i@J;Coussement SVM, Logistic HiSffl RF . till. 

Logistic ^M,{S RF 

SVM;Burez F 5 RF W 
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AX.Artificial Neural Networks,ANN)Jq|—#^'14iSfii 

m « 20 m~z 40 mxttgH»Bgs 

ANN 1943 W. Mc¬ 

Culloch ftiw. Pitts 

1948 ^,?^ • ^M6£ffifc+«lij7Um#tt 

»7cttuaw#^s?6ffl.l«l^ft»20 Ittta 50 ¥itA,F. Rosenblatt i&i+f&ljft 

Jll«ifc8ttttitX«&tt; tt, &M2* Ji-IXI IBf 4 

m«s sn, fae &m# &mim , a® ai*§ 3 

20 ute 60 ^ft^^iWid row tgaj7gitaz 
W *6, ft MUttjbn fn ffl ft R *6, * Itt: M, ± £ Jg 

ANNiS. S'J 1969 M. 
Mins A& JKT Pereeptron -^5, T»AW4)“#f, IIffl 

T*«iaW(5|«fP^JE. ttff1Wife^*ffiAeft±»ifi7AXttgW»WlS: 
M.ffiAXttaW^WW^ttTffi#!. 20 ^69iflJUg,l982 3MIS 

Hopfield i§tB7 Hofield tf£raft«|3! f 3l AT“i-tmm” 
1984 ^,jfeX|iaj7&&&tlJiJ Hofield ffi&kWi 
$*£,*#£Hofield *FfcJ7tt£raS&ffl 

7«iafc fnffcftit^ MSf &£, A rt 7 tt s m & Mffi %, #3 I fi 7 g 

&amijb* Hopfieid so 

+38 w* ann ww^«i. 1985 ^,x^#iia7a£5M«M.fc#3 

1986 ^i2 

&a#3a7#^£i*s£MM,£BS#iik&i!fcKF 1990 i a 5 hx- 
4H^&r*MI 0 cl+»(RWC)”J5ig'a,AX|?t^j®f^jfi7-7 
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ia¥*.Ax»aw»iH*«#iA^»watt±Miin 
m am, ,$ a asm 

i«tt, E^iSSArU^. 3fc*^WWSTmtt,*AXttgW^W^»ii 
2fcJR* 

^Br • J/WBr£ 1763 WijEB^M-^XPlntWrMW-W^o 

20 tttffl so 

Hnt9fS3H*»3ttT#E^W±j»*#fS* 
ltt*!iJ#SM«£. PfBr*£i+£/sM3».«&S'J >M 

hk nw x- 

fij«B^ 25 o* 21 

£J¥TM**«lftUfl. aitj.IB 

wf-Jwmaaa^saTrew^ft. ipb mmmm*x 

wmm ,n vx a »-3i^#tiE, mi £#iie wmm, 
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mm dp 

(2ttSWT«iaWItt 

r 

ft 2014 ft- 

i2^»t , atni!4n.^(ocF)*ttig j t«fl#±iia»^*ftigffi^fS« 

&#VF&VL»&: 

WITffttl. #»JJi*aP^SE^rfe.iin^gEWffiSS*ifi4P (Con¬ 
densed Nearest Neighbor, CNN), WL§(k jfi §1$ (Reduced Nearest Neighbor, 
RNNK££*ifi4P(Edited Nearest Neighbor,ENNl^RSfflTft/hafllW# 

1,0 Angiulli ^ft CNN WH5l!i±^Jifi^^maPI'J^Hi-#ttiiM*i£#13» 
fe(Fast CNN,FCNN).Mf^ft^#ftHftl^W#fto Jordan Hifi— 
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■■ itoixi«r xiyuanlijiv ingyong 

icigw^fiiiwM. 

Bootstrap if 

M^eftElaJo 

Jordan JlfJi-TOjf-Bag of Little Boot¬ 
straps, Bootstrap Mi6tt®, #_i.^if £i+»_t 

STilfc, Jordan ^HiS^ 

n 2006 ^ 

Sagheer S ^m^ftCFast SOM, FSOM), 

^Mm,PllJf^lMJ$^^H^f0]o 2007 ^ Quevedo AMMWffl'tt. 

* M «F Mfr, MMfefH IE£tt. M fcb--#». A$ll« JT&, ffl 

2009 ^ Hua 

2010 ^ Gheyas Xtis,it& 

Simulated An¬ 
nealing and Genetic Algorithm,SAGA)'M'B‘^&JJJf 1 @l^i:i^ 

NPfft[0]|l5]@ o 2008^KoldaHtfl—Tucker M^f 
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2010 Pal SVM 

2010 ^ sun 

#!£»&, 2011 ^ Anaraki T-#^W(|[tt*T«li!TiS^W«il 

Quick Reduct 

l-frfsi mt, 

Wi&m'pmmrmmwL' 

m'pm.mm. WAMWi^^p 

stto 

rr^tt. 2013 ^ Song hsf&m 
3 SVD.RP « PCA,^*a 

sir 

SJi. 


• ii • 



■■■ HOlXlItXI YUAN LN1V INOYONO 

ffi.2003 ¥ Lau %% SVM Hfij—# 

2006 ^ Laskov 

2008 ^ Huang # 

2012^ Kim 

(D&±MTW^®^^^ffi.2010 4p Ben-Haim 

2012 ^ 

Franco-Arcega^il l 4iT-^R^:a^^^^^3i^«M6<jM.if^^Htj» 

•& 7 hhj-iwj 1*1 # 

®*#fiW^-^«i»^«L*-ffi,2006 ¥ Huang «^$Jf TI#«M 

elm,, 

*Btm mwmmz 

itiiiih 

®*^ffl«*W^^r®,2008 ^ Li #i§aiT-## 1E#W^»&. • 

^*a«ffl«»lg*W^ttlB(5ia.2011 ^ Lin # 
lltfl7#»fiEtlftfP^#S#ill|^iiill**¥. xmmUJfc.fflfS Hadoop 
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»l#/« tfc 

Mapper SVM,||Hi#fr¥#l96tll#« 

Parallel AveragingStochastic Gradient Descent. ASGD), AT &fc81 Jl- 

W i20^SHft,ioooHSMffl|ftlS[|g,*W«ttW«caiS«. 

r^o 

$n 2012 ^ Havens 

ttsftrswmiHc^ficFCMiR^jiiftxtT^ftigttifctf*^. 2012 ^ 

£#±W^Th#«MSS#±5tt 
*81 1 . 114TB ft 10 *t#igatfTJH3&£lfr. Jlfc^.2009^ Zhou util MSTffl 
M*U£. 2011 *£ Niu nft TIfp«SSI£. n ¥ Vidal R £it} 77£ fa] «% 

iP 2012 if Luo $&£H 

nJMl&fetif MapReduce Hiilffli+ W-^5^J(ComputeUnified 
Device Architecture, CUDA) 2012 if Zhang 

MapReduce 

2012 if Palit HHiii 2 BP ADABOOST. PL 

Hi LOGITBOOST. PL, tiff] nTffi^'Ht JTH> £ N 8f#^3if ^ ^LL ^f ia Ml - 

MapReduce 

S, 2013 if Kaiser ^HJM MapReduce *8Jttg»3*3#L 

m • i ® 0, i^ b* Kaiser jrikmk 
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ttaSMJEHXJSJli 

mm j i oi x u f, x i vu A M i. u rv 1N q.v o n o 

«PJ^*^Tfe,SiS3|£i$(IIE«W*S«[|g. 2013 if Upadhyaya iliiffl 
Graphic Processing Unit.GPUl^Fc? kk^rff 

4h&i? 

flSflWtfc. 2016 ^ Shim £ MapReduce ®&T.t*ifcirafaSiHS3feM Ma¬ 
pReduce MapReduce 

1.3 

1 . 3.1 

( 1 ) 

(2) Jl 

1 . 3.2 

(Dja^i^ 
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% 1 $/* ft 

(4) Mf5:Hl&<lMfgW«l#^,f*^ . 

1 . 3.3 M.^"&233r5SL#J??4*■ 

3£S*3r£»l. 

ttte^g) s w to s «(&/&■ fir§■) ft % $r a , vx mnm & 

1 . 3.4 M.-3F-4&m-mA&)Zd'-m- 

M\\^ MW&Z . 

n M , Web eig^. 

1 . 3.5 b 

Asa»^^±®^r#aw^g. 

(5) jmH-Jwra»^i^M0#^*JimiH-»rw».*#iJija*T«» 
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1.4 

1 . 4.1 $XM-»4>f£D¥Li& 

frttnm , . #$,+, nm . mat n um & »«&#?-** 

1£1§!o 

2012 ^ Hadoop £^tt##;g«ttS*Ji->MR#W0!l ; F., 

2012 ^p.Cloudera l&Ukj Myrrix^'frJ Big LearningtiAilt’M^r^^liJI&nP 
£7—£*r&a. Hadoop 
m CPU i*Ht, 

df HIiSIt TB Mydrrix M. Apache Mahout 3^ 

MyrrixfrJ&AOwen£££^4^flJ:M^EI££-^W/L + ¥J5 

«#rja»Hadoopffilft*W^»IBWJ«*»ffi.^^Mtt-ffllllSf. Myrrix ^ 
Hadoop 
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mmwmn.%, 

• 1.4.2 

Affi. 

(1 > m%%. mm feis a ) mmmmm w, m wiw^w m « 

tetrc 9J W J£^ «*r S, W.W*, ffl « X^iR 

»j, n mssmmfrARm^iRyA .mmrmpjA . £{+m . 

*8* & « m . iu m a si *h 11 £ +; m ie & ^ « »j ^ tn. t§ # g ^ £ &- * 45 m 

. amir 

»JB£^rT«££®. A 

m^2 pj ii - ■it w m mmp xm w * se 

t&iiPo 

«&. Afl&tfc#ift*0iim&jrF«£«tt. 

Hitt-Afn#MW 

mnprn mm 'M*m s m «- n . ^wa in w a min 
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■■ JIOrXL'F.XI YlfANl IJIVIMGVONO 

*e 

Mo 

1 . 4.3 

^J^^4*^#TJ®M,1982 ^.Stormo 

1988 * Qian #£^ET-|g 

a-sus** wife*, i&immtmmm j^mm 

afPltiErgWM. 1993 &f .Borodovsky 

MM$j7o 21 + 

Cheng T DNA flftft$|ft|g. Long K Of 

1 . 4.4 M.r-M\te<m&L 

a hit a^ w it , mam a 
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$ 1 ft/* ife 


2012 ^ Google -AM^ 

m *, i &M5&IB, «#lJ»aiJl& WffiS5!«, «T W ilfct# You¬ 
Tube wm,A ws^Mtf, 

S«F3e»*WSia?«l*l.ig*.-& > hW»fliBfi^PJT-S3K®, Google# 

^ltbI^0t,Googl e if®^iM^n$T 2012 ^ 5W#TilftS 

Googie 

2013 ^,Misrosoft CEO ji&l&Mfn] Craig Mundie ltdbM M Sftil A A^^ 

^wiw*#»iia*t@WM^Afc3iji ; ftn.»#^w(5i«,itiHir«i3ij»A^ 
® g oj iti-^MJl#, MM. 

fflo 

1A—BAA—10—79), ft# A“ S il®*? ffifrAM WJ(BLADE), «0f* 


• 19 • 



m2rn 

ife. «ffMWf=gfTH)^WTi.SllT«^jl-n»mW^ 

x^m. 

*ai»rtRjtfTTj». 

2.1 51W 

*w*rei3tffl wm#^^ * ,-^Mmj.M wra«dM*3£iMi*r 
m&m& ,mmux MtiK-^/So 

m, mmm-^ mmm ,stssiME«s«i ( «js . &$ j$m ) m 
b # 1 1 # m w m m ( m & ,t p nn is > , # st*) w m &. 

jz-^TS-tM& w »^ (*tt > »«* 

<&(pfiig)«. a^asniw mmmmm^mmfrMWish ,#%&a 

ffl 2-1 M^TM. 1896 

$js3&#(ffi##ui#)j§ : J i ioo isms 

loo *$ 

jmm *wiejttHtra. m« . 

»0t m witt-H*, , nrn^n#ft^H*( $p 

fcffi.iiilH 2-1 TO#iti,^fp^jft0*|Bj^(BiM 
-0} fa] A;S»0t I'e] T 

mmmmm >, jb u M^fns i a $)£&&£&£ m±msi . 
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^ 2 



® 2-1 M. 1896 100 l«] 

(vis/ji 1914 4,1940 4*» 1944 4*-f t «r 

2.2 &£&# 

2.2.1 3^x«-ai 

s4*{g($i&tfH> mssc. *f TJitt, iwi ia¥#w» 

ficjp 1980),JS^2:£E^-^&5£($toMJJ-Sii*¥?F*&. 1980-1896 

=84),axif»*wfias^siM»j. 

±,«ii£'Ha* r =/(*). 

x 0 f^UftP ,tlP^ fix') =sin(x), fix) x*ffe'ffTSTUl'H‘Wo — 

IMtWffl t=fix-,a)% 
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■■ j iqixu v x mi any uiy 1 ngyon r , 

2 . 2.2 

ft.* 2 -umn»summ& y tim#T'£% 

t=f(.x)=x (2-1) 

&ttH*ffl^*is£¥«hx>1880,t<12,K*WM£fc8J&ltflS]£T 

t =f(x;co) =coX (2-2) 

as co s vm 

ms . 

|g^Wgtfl,J4Ji^3E*W.ScJ!8»lgW-gj©».«E o 

t = f(x;coo »coi ) = coo +( 1)1 x (2-3) 

VFgmmmttmsMo m 

mm 2-1 MiASfit W o m co, fcfr&SMte. 

iUE(coo,iii-^/ttw«iE)flii**(»i,Mw#S),iux0c$'Knw«* 

(effect ),im 2-2 J5ff^ 0 



, (a)w u £(jlMli*'£7S^t^lSI&A'j. (bJcu.WJfljn&^Tfi^W#® 


a 2-2 m<\£mn*^$t<oo ^ w , 
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W> 2 


2.2.3 

uo mm 

ftmwxt&n 

( t„ f(,x„iw o*ct>i))“ (2-4) 

(t„ — f(x„ ;u>0 fUJi ) ) 2 WJlW'jj ■$!&&■ Tli&ffl /(x„ ;wo .wi ) 

«#U. 0rffifcW«f*. BP 

L„G„ ,/(jt„ }CO 0 »£0l )) =(«„ —f(x„ ;u)0 »0J| )) 2 (2-5) 

5£(2-5)jy&«4£Wfflfc. 


Zrf jy Zj lv M ( t n <y( J n IQJO tC/^1 )) 


ftUoWWo,, Stffffi.ffl 

i n 

flrgmin». ^. Z-.„ (/ n * j(x„ • cvu 9C01 ) ( 2 - 7 ) 

cuq *ojj Jvn — l 

argmin 9l*»^±“tti!l*/|x4fc#»”Wie^. fti*^*^* - #»£ o,o 

mm m 2-3 

tiLLM/M&& a ,M1g.M a ,=5. 

Gauss fP Legendre(1809 
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m 2-3 -£jMt(<u)«*.&4tttW J f- 

a>=5 Bt.^^cS/Js) 

mj i.&M'kmmv , z^rftflbiS'&iHifi wfia^fegft. mamm^, mm 
s^PT 

= | tn /(X,jo,o.0»i)| (2”8) 

fPoM ft* 

2.2.4 JB.<N~m*f 

w s &mm. Sctn mimb a *«=i, 2, -, n xa$ij m $, 
•Efn+w^-^fc-^x. ftj®. 

ttftliitt 

f(x}u>o iu >\) = aio +aj|J (2-9) 

o>0 in an + w 

► 

J N 

L =j^ S Ui^ +2wix„(co 0 ~t„) +u)l ~2cu 0 t„ +4) (2-10) 


• 24 • 





$ 2 4/0ltt*5J£fl]9& 


L Mfoo fPo,, 

0 o 0«o>o fto>i. jet.oii 

lo+TOtw, WinrWMHa#»3;o), £*£» 

J^ffij 

■jr; £ (a>!xj; "l~2aMX„a>o 2 ojiX„£„) (2 — 11) 

*U, 

#-=2wi ^( £**)+£(£;*(«,,-*.)) (2-12) 

c/c«i 1 i\ n = l i\ «=1 

ffll^#W2T&,*Uo $«#»*§ 

|^=2 W0 +2aii ^-,(IIx n )-|-,(£o (2-13) 

C/O»0 i> „=1 IV n= 1 

«o *p«m 3/T 

5Ct«o jfilaM #*?. W^J&^JFM.«FS:(2-13)«**0,#B.^' tB o 


2 v i v 

0 \ T ( <S ) (l) 1 * T C /—/ *Tn ) 


(2-14) 


J^PP-i^JEfeBtEI^zr?:^ =4; 2 t„ x =4; 2x„, 

ly ti=\ i\« = l 


Cl >0 Ak. bIWS¥ a>o 


Ct>() 1 1 OJ 1 X 


(2-15) 


«o+«ii.)MS»f#3PJ,aa«. fnx. fo^ «(fto #Jtft N^ 


1 N | N _ 

~z~, 2 t (x;cuo '(o i ) = "x7 2 (u.>o 3'cti i x) = wo ~(~w iX 

i\,. = l i\n = l 


(2-16) 


^inffl^(2-i2)#fij^Tc5 1 u 1 

^#-^^(2-12)^^, 

^f^’tj£(2“13)^(:^F cuo 


d*L _Z_ y, , 

9atl~ Nn-*’' 


(2-17) 


• 25 • 



(2-18) 


m»$3JK3&£j|j 

■■■ IJQIXI l XIYI ANt IJIYINOYOM. 

^L =9 

del 

iem, m & 

M/jvfi. m<.M4'fcm!km®L&} co 0 

W1 woo 

c? a>] 

37 ON _ 9 N _ 9 N 9 N 

5 — =(iii xt( Sx^) +t -Tj( Sx„) —wiX -rj( 2x„) ~Tr( 2x„f„) (2-19) 

0(1)1 /V n=1 /V n=l /V n=l i\ n=l 


«cMx = (1/N)Ex„ m 

n — 1 


it =2aJi [ (N ( „l x - } ) -xx ] +2tx ~ 2 N ( S XJ " : 
1 N 

w(Sx,(.) _ fx 

_ _ i\ «= 1 
“ 1 N 

Jj ( 2 x 2 ) —x X 


) (2-20) 


( 2 - 21 ) 


n“l 

SiA&'hl^x) 2 
- * 

Jird/N) Sx„i„([^#,'tI-^?Ffo ]) 0 $ti\V$-'fciii : %lJrt 0 wi 

«*=1 


_ _ X l ~x f 

® l ?-(i) 2 

^,nJflJfflit:(2-15)fq5t(2-28)i+»;i J ,ft^W#l5cfto 


(2-22) 


2.3 
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$ 2 $/ 9 itt$ 3 Sflna& 

fa*,*,,-,*.1-8 . 

t f(,X 9 S\ 9 * * * 9 S$ yUl 0 )"*»W 6 ) 

= a»o ~^~wiX ~^~a) 2 S\ w 3-!>2 ~t~cdsS 4 -t'aieSs ■("C07-S6 “^aigi"? ~t“a>9 $8 (2 — 23) 

Zfs,nm 

-fa*fn$gp$ 0 



x„= [x nl ,— ,xm ]. ft®fn#¥8sjn«i^w®#Btiniji^^saxt 

to*&#is(/-« 0 +»ix)«i^. a*5»mftw#«aT»att«o»«, 

r±^j j:.,bp 



<s*x. Ww.jik^aHrw^* 

f(x„ ;a>o jttM ) =w r x 0 =a»o -t“ a»ix„ (2-25) 

U) T -Xn #&<*<, +»,x.,tt*n,¥ 2 f*fc L BlW 

L=x r (^-X w ) T (f-X w ) ( 2 - 26 ) 
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J iQi.YUF. XIYU ANLIJIY (M'CYON C» 

&£(2-26) + ,Xfll* % 


X = 


r-r 7 ! 

•^1 


'1 

■Ti 


*1 

r T 

x? 


1 

X2 


h 

1 


l 

: 

.f= 

: 

h 


.1 

Xn 


./n_ 


(2-27) 


r^L' 


3L 

3cn 


<ho, 

3L 

Li ')(!} | J 


(2-28) 


l3)fP^(2-l5)^M7c*Ji-^W. 


2.4 


mu. ioo*»jg,'e 

aTfS^ifc. 

£tmm:fc«l£l&8&M /(*»«) = wii +^,x s— > h^"F#3K(»)fll(x) 

^®^WI»,iP^:(2-15)fn^T2-22)4 , o 

fSCIitM x?,,rMM» x 



'1 ■ 


"1 

Xl 

-Tl 

x„ = 

X„ 

,x = 

1 

X 2 



1 

cm s 








. 1 

Xn 

if( . 
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3ft 2 $£/tfl§&^23#iSISTfc 


(2-30) 

f(x;uj) =ca , x =coo +W1X+C02X 2 (2-31) 

IB+fiZUfcM. 2-4 

Sft). iA®4 t oTli(#SiJ^ilil^W®i(^m^^14(«Jg4')^M 

40 
35 
30 
25 

20 

Ss 

15 
10 
5 
0 
- 5 . 

® 2-4 *.*Jt4AW4fc4Mt 

2.5 

1BS®3tE3gai«iaiW i WiliM WI 

g£#«). as«aT,«fnH#jifcjS#*^JiiL»ig±tttB*ifM«ia(iP 
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IM.HXl.1 YIYt,\\i I IIYINO'VOMO 


*T«aia3iEj6ia*,Mwifcj8*aaifi^m»ssiig. 

«&*£.MM JKSSfc^ffiit lift. *T£IRtt8te,»$W2ft,$£ 

2.5.1 3&iiE*t2& 

wwwttii. finite pj iAJ^^ijii^;* * $ hi. mtu, 

^looMJg+^WiAilll^^ib l98O^WMM0ra*ii£«MgfE3&3& 
il*„ *Ti4MMM.nnUM/jNWiJl|^*±iJl|^^-^NiS!,^^W 
'£ff]£lfcffifc±Mifl$:. ® 2-5 ^,(a)ffl(b)^SlJJiiJI|^fO(log)MM^W 

1 1 ftgwttmm&ikmjj'm&i* 



£MjK.Wt 


(a)Jfeis^B?100^&-te&<jiJI|^I* (ajUis^ll^FlOOJiejRigMlogiftiEfflife 

S 2-5 100 

2.5.2 

$P® 2-6 flfjjs.K ^rSyt^iEiCftlg^ja^J'ffi^WK ^(*#^16 
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$ 2 

k mtiw-tsaai.^ K =N,BP K 
itfe n-i ^*+iujii£$#pjm§l 

;IE(Leave One Out Cross Validation,LOOCV) 



i 

I 

♦ 

Q><) <J m 

@ 2-6 3 c^i£ 

(>i : £^ K 4fr, M A - * ft £^in| $ £ + # tb . -f *] i* 

mm 

2.5.3 K ifr5C-3?.^-jJE6l7i1-3|t«&ifc 

tt£#BTiS#«rStsi. %m,%m loocv m£«. 

vmm. /hw> . w«a,« 

^HSS > hffi]@*itiW£fesfcJiihK«N 0 0Uin,£10 $f£Xtfcffi*Kflm 

90%W^o N-io W 
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■■■ JIQIX l) EX) YU A NLtJ IV1NGYONG 

2.6 mi * 

is 2-7 

till tm &i<H# 


0Pt#« 


<3 2W 


♦ 

(><) <J * 

S 2-7 100 

ja® 2-7 bjw 
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W> 2 imatfe 

^.|B]”,]fff^“^fim^W|0]-^r” o 

mn& /(x.ao =<« t x,m 
'ftAttrw^saw w 

Jtt&frlS]. ffl 2-8 S&ttiTiifl , * , *feJ* = ^W 1920—2000 ^W^EttB^Pil. 
2-7^Slli:M^I«fi. *Titaffl»|gM«i3ESE3fc,«®«jto-^ 
m&s 2 - 7 araa&ssg^ra^MtffiE. 

C1)SiEAS^gSftW .. 
(2)«nwA/j'iR^ri^-^¥^ra^a^rwaw^. «£*«&jfeg£ 

^r{^-r MiSISt. 



a 2-8 


M >& ft W m #1 A/h M &t m (f *&), -5 m 
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■■ JiOIXUlXlYDANI UIYIM&YONG 

%Mtf\'B\,#Rp]VM'ZmW r x ±. tt3fcm®M«*r$tt3IA#IS!WIA 

2.7 

2 . 7.1 M 4 n. 3 t* 

ft. ^JM-^^pT: 

y=5x~2 (2-32) 

^(2-32) x fP;y Sfn^iI5P^B^^4 J -'t(^JiP3' = 

8 ) tiia-'Hx =2). MM..K 4 H 

ttfc.&IWftftflm&Sftfli.. ff&Bl 
X,in£lElii«±!«£ x ft l.SJBI* 0 o x £->MBfitiL$f;- 
“wntfHS&T x oa> ,mffimto u mvi n &8 

w^iwio 

sffiWfF^.amwiisyfe^iiBisitfiif^ffWnriiw®*. wp.&tmta 

6 ). 

l&*3i<&J§ : F loo 9~io # 0 
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$ 2 #/mss¥33#5asife 


9,9. 1,9.2,— 

9 - 9.1 %.m 

mtmm , H«m£fi§r to « 

9,9.01,9.02,—,9.1,— 

{HJ! 9-9.01 «£££#? 

9,9. 001,9. 002,9. 003, —,9. 01, 

m&mmvMm, 


m 2-1 


i±*I 




M^- 

&& 

100 ;s|Ut&tf &1H 

&*£ 


Si& 


&& 


&& 

$P ^5 Ijfi 3l 



*■£ 


2 . 7.2 

rT56UB®ta^*„ lEffi.Pl'J „v = l;&ffi.MiJ y=0 o 
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■■ JIQ1MJEXIVUaNI uiyinGYONG 

&m±>. pcy=i>j£**—###o. 5 

W#Wt6).Hj«:Sli9!±W#tM 1 M*IEffi«±Wtt^Jo HHt.P(Y=0) = 

1 —P(Y = 1) =0. 5 

namm, 

j>u* tk$i w«t • mtmmmm&mmm . 

< 1 ) o< i^ut/j^ 1. 

<2)wwnTM^^wteEtefn^^T 1 . 

P(Y=1)+P(Y=0)=1 (2-33) 

«f: 

P(Y = 1) +P(Y=2) +••• +P(Y = 6) =1 (2-34) 

0<P(Y=.y)<l (2-35) 

SP(Y=>)=1 (2-36) 

y 1 

n, %Tmmm$w . e s^xtsitfL 

y 

I1YMSI16 ( ]®III. 

P(Y=y)£^#*,BP«tt$*YJRftft:y 6SII. 

P(Y=y')=P(,y'> (2-37) 

M^Mfiwft^(MW3')^'efnww(P(3'))^M^^i ! iJo *6 • 
^0J^W(i)iof5IMWoTMW^±Mo 

il#.*fnttffiS:(2-35)jBl^(2-36)ST*®$2f:(g«3|6je^«46. »£ 
«Tp^^,^fnfgi5lE,SW^^^Ji#or^W:P(3'=l) =P(Y = 0) = 
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$ 2 4£/mSS^3]#ffiliSifc 

IT-ft rlft{&o 
• 2 . 7.3 

ftyiniMSiftttM 

2,3,4,5»6)W*^.te»-»ft¥j./S»Ji 4,#Uctt»«?./S«/J'^ 4 M4K 
/hT 4 K2,3,ii^WSifnffi^tt-3H»^tbSE 1,2,3 

£&5W. Mfli'fegWTi^.iAMIf££tm*-j6»aSEMtfc 
f^j. tn*u2,3 i 2 jfeMttffinuaaj 

i® 3 j^wtk^j. &3i#am»afc*wins£$: 

P(Y<4) =P(Y=1) +P(Y=2) +P(y=3) (2-38) 

o mn,& 

lj&3fc#6j£W«M&£P(Y = l>+P(Y = 6). 

pcy#4> =P(y<4) +P(y>4) 

=p(y=D +pcy=2) +pcy=3) +P(Y=5) +p(y=6) ( 2 - 39 ) 

P(Y^4) +P(Y=4) =1=>P(Y^4) =1-P(Y^4) 

2 . 7.4 

fclin. 

yh*. umjEmm±,x% i,s®®±.x*o. 

®ra,*o. laM^n.ywftifx^i. &mm 

P(y=y|X=j) * ( 2 - 40 ) 

ilf^^Xftt^x B4\YM7?> W$o 
JtaTMfire: 
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HQrXIlEXlYltAVUJIYINGYONG 

P(Y=y\X=x)=P(y\x) (2-41) 


IE®MMl(£J 

!££). 





P(Y=1[X=1)=1 

(2-42) 

JttT&iH&A- 






T—< 

II 

z^-V 

o 

II 

X 

o 

II 

£ 

(2-43) 


P(Y= 0|X = l)ftJ P(Y = 

1|X=0): 

P(Y=0|X=1)=1-P(Y = 1|X = 1)=0 (2-44) 

P(Y = 1|X=0)=1-P(Y=1|X=1)=0 (2-45) 

MffifijEiBf&iftlEiiiWfc** o. o. 2 0 fcatfHWfcT.Sf 


P(Y = 11X = 1) =0. 8 

(2-46) 

CS] 

o' 

II 

V 

X 

o 

II 

>< 

a. 

(2-47) 

P(Y=1|X=0)=0 

(2-48) 

P(Y=0|X=0)-1 

(2-49) 


.ffi^#»fi^:(2-36), £P (Y =y | X =x) = 1. &g’ 
SP(Y=y|X = l) =P(Y = 1|X = 1)+P(Y=0|X = 1) =0.8+0. 2=1 

y 

(2-50) 

EP(Y=3/|X=0)=P(-Y = I|X=0) +P( Y=01 X=0) =0 + 1 =1 

(2-51) 

m«&W&*Hgi&P(X=l) =P(X= 0) =0.5( W@rfi£&¥M).IMn' 

P(Y = 1|X=1)^ ; 

• m«$MX=l BS^,B6-^«ueW**ITW 
&ffiS&Mra®^&&W^*fKx=i*nY=i>. 1^1 
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$ 2 

i)« p(Y=o),smim^miEmm%fcmtimm . fcjtt,»5£x*E¥fn£ 
MfciiR, assiMftT-/KUrafT»«?. 

2.7.5 
Efcl 2 
«E4*. 

P(Y=y,X=x) (2-52) 

^(2-52)&bT*^J®®»^ P(y,x), 3fcmSJSe£4H&Mflcig±5* 

X(««m 

JH). 

P(Y=y,X=x)=P(Y=y)XP(X^x'> (2-53) 

YJfcflljr#Jax JfcHx WfcWTYlWIjy WIIlKXiHli 69«E 

p(y i,-, y 7 ).ffl*ji pcy, = 

y,,-,Y/=yi).XtT/ > M8l#l$JI.«' 

P(.y\ iyn’”,yj) =P(yi ) Xp(y 2 ) X>- XP(yj) = IT P(>> > ) (2-54) 

> = 1 

P(Y=y,X—x) =P(Y=y\X=x) XP(X=x) (2-55) 

P(Y —y,X —x) =P(X=x\Y=y ) XP(Y=y) (2-56) 

P(Y=1,X=1) =P(Y=1|X=1) XP(X = 1) =0. 8 XO. 5=0. 4 (2-57) 
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/lOiXMtxtvr \Vtuiymcvom. 


T)TI^M0.4 o 

X m Y ft 4 #nTt&M££-,Bjltft 4 #nT|gW^^o 5£(2-36)3inij: M 

m 4 i. 

EP(X=x.y= 3 -)=l (2-58) 

x.y 

«(2-58)^.S)(M#^x,3'^4#orM^'(f<a^o IfeOTlUtt 

x,y 

ffl^(2-55)tt-»Bff>t1fM^*l^(2-58) 0 miE£M P(X=1,Y = 1) = 
0. 4„ g&ffjJi: 

P(Y=0,X = 1) = P(Y=0|X = 1)P(X = 1) =0. 2X0. 5=0. 1 


P(Y = 1,X=0)=P(Y=1|X=0)P(X=0)=0X0. 5=0 
P(Y=0,X=0) =P(Y=0|X=0)P(X=0) =1 XO. 5=0. 5 (2-59) 

M^$EWft-&»BP 0. 4 +0. 1 +0 +0. 5 = 1, &W W. 

#->Mt(o. d^t* 

i&Mim 6SWI0), m%W ff5 M. S&-^«(0)£tH T W 

ftJi o. 5,0ft 

) 

2.7.6 

P(Y=i)fn P(Y= 

0).&#£j*5$ift^fea-X. P(Y=y)lWLMiZJAW&M&P(Y=y,X=x)‘p 

mmit xmm. x 

P(Y ^y) — YjP(Y=y,X=x) (2-60) 

x 

ft mtm flj , x ftipiM^ftKo j) ft w—^ = 

P(Y=y) =P(Y=y,X=0) +P(Y=y,X = l) (2-61) . 

.ft P(Y J -=y < ).pTWiia^TW^: 


P(yj=yj)=P(yj ) 


>■1 



(2-62) 
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W. 2 

«S(«^^)WMniiifWip s 09an.in. 

* J =3oa.SP^^TitW P(Yi == 3'i) =/>(*i)$1f£ 

. *t >* *n 3* 

^2 _ >3 • ’ " 

0 0 

0 1 

1 0 

1 1 (2-63) 

$nm J 8: 

( yz y* y* 

' 0 0 0 

0 0 1 

0 1 0 

0 1 1 

1 0 0 

1 0 1 

1 1 0 

1 1 1 (2-64) 

inn 

rsmm 2 , w&mu%.mmn ,xt^sa? 6 j - j ). ***m 

(Y = 1)JMJ 

P(Y = 1) = EP(Y=l,X=x) =0+0. 4=0. 4 (2-65) 

X 

#RP(Y= 0)ft,HJ 

P(Y=0)=EP(Y=0,X=x)=0. 5+0. 1=0.6 (2-66) 

X 

fSMTOflyB P(Y = l)W{tM(2-36)tti| P(Y=0)|ft{g o iilSM 
&ffiW«fc»AJ6»:»Mtt«!l(P<X=l)*=P(X“0)=o.5). 
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iigrxirmfYiMMi uiyimcyong 


2 . 7.7 


eih-jwmmih] 

4^(2-55)ttj£fJ^(2-56)W£«*ffi^IW,Hi«;*IHfc**^W,EP 

P(Y=y\X=x)P(X=x)=P(X=x\Y=y)P(Y=y) (2-67) 

Y= y &{$t x p (x=x \y = y >,atif 

x = x ^# tyw «$. 


P(X=x\Y=y)= P(Y >>VT X j) (2 " 68) 

P(Y=y ) 

Sl« rfi , X Mtt£{K WfiKI W Y =y 


ftlilTim. ' 

ItAMnTWit^ai P(X = 1|Y = 1): 


P(X = 1|Y = 1)= F(Y 1) 5= 0.8X0.5 =1 (2 _ 69) 




P(Y = 1) 


P(X=0|Y = 1)=0 


0. 4 


(2-70) 


P(X=0|Y=0) = 


P(Y=0|X=0)P(X=0) _1 X0. 5 


P(Y= 0) 


0 . 6 


=0.83 (2-71) 


P(X = 11 Y=0) =0. 17 (2-72) 

^(2-69)«<2-70)( BP Y = 1 ) MMrfi M 
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M,^(2-71)fn^(2-72)^{i^iASffi(y=O)0«5^r1iW*^W o PCX 
= l|y = l)=imBJ,«IEffl^«jEffi»5fi1iW«^o P(X=0|Y = 
. o) = 0 .83 ^,jp*^iffaiwJisifii.iP^«riifibafiffi(«E4E® o. 83) ittam 

2.7.8 -warn. 

ffl 0 ma ,w 

,*»>■ 

E^if/CXX-S/WPt*) (2-73) 

X 

x ift$M(^{i)^ffi,3|54 /(X) =x,#.sjli*j$ 

$3/ 

E P(x y{X}='ZxP(x) (2-74) 

X 

tt'F&^WimPC*) =1/6) ,X MIHMttJt 

Em, {X} =Sz J=-|- +-|+--| =y =3. 5 (2-75) 

hk &tm ? * He f n & & sij , m « * * n s r® #l $ * *1 gem it t w -—^ 

(i0±^^4>.l5im$*M^nTM 3. 5 J&). 

wn,/(x)=x 2 

M 

E P(j >{X 2 }=2x 2 -|-=i+-|+-^=^ (2-76) 

-Mmm. »^±.E«„{/(x)}^-jg^T/(E«,){X}. wan. a a hi;* 

i+HT Em, {X 2 } =91/6,*£*^T(Em, {X} ) 2 = (21/6) 2 . 

W«Ttt^:^li«tllMX WSftft-^llflSailUX »t. *a#f»«T,iia 

i£ /(X)=aX,W 
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(2-77) 


29H JK)fXUIMYl(,\NHJ|>|NOYON(j 

Epm {/(X)} = SaxP(x) =/(E«« {X}) 

x 

®I$P/(X)=a,PJ 

Epw{/(X)}=SaP(j-)=a (2-78) 

X 

iXM+ltlffl): 

E«„ (/(X)} +*(X) = 2(/(x) +*(x))P(x) =Ep< x > {/(X)} +Ep« U(X)} 

(2-79) 

var{X } =Ep (j) { (X— Em, <x} ) z } (2-80) 

t«r{.X} =Epu) {X 2 } — 2Ep (x ) {X}E p (jc) {X) +£«*> {X} 2 (2-81) 

Ep(x> {Ep(x> {/(X)}} =Eput {/(X)} „ 

Epu> {/(x> } x m >, *hM m 

^ Ep(x) {x} 2 M^tetf.iamio 

i;ar{X} =Ep<x) <X 2 } — Ep(x> {X} 2 (2-82)' 

H$1 X JtiqT: 

Ep(x) {/(x)) = 2/(x)P(x) (2-83) 

X 

Ep(x> (x} = 2xP(x) (2-84) , 

„ caw{x} =Epu) {(x— Ep<x) <x})(x— Ep<x) {x}) T } (2-85) 

M X ^ D «w{x}£—^ DXDiW. 
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$ 2 ¥/#lff¥33Sfl!S1& 

& itmmX ' Wtm ?3 H 7 imtetiimm & m . 

xj #u, xtj®—''h^ftjJECt.inU x d tfipjailx, &if ip, $n$ 

x„ IftMJ X, */J%) 

? 4 z 5 l)o 

cow{x} =£p (J ) {xx' —2xE P(j .) {x} 1 tE P( i) {x}Ep< x > {x} r } (2-86) 

S | ffMa ^( 2 - 86 )* 

coi>{x} =Ep (X ) (xx T } —Ep (x) {x)Ep(x> {x} T (2-87) 

2.8 IjtlSLWIItt^ 

2 . 8.1 

£ 4 H 8 fa»*l 

(Bernoulli) HU . 8 ff] B & Mil *E. $P: *6 £ £ ftlTM ® rp 3|5 # * 

xmtfllMX ,RTW®1®*0*1(-7C|8I 
#L$S>.J|W&®* 1 W«^iS*9,WI<0^J^"rW^JPT* 

P(X =j-)=q r (l-q) 1 ~ r (2-88) 

n =i 

2 . 8.2 —^ 3 ^^- 

HflUW . 

ft±c nY BTKJfcM. 

Jjj) ~N(N S»J])WftIfl. 
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JIQ1XUP.XI YU A Nl UIVIN C* VONO 


P(Y=y)=P(y) = [y\q>'a-q) N -> (2-89) 

«±, amain 

-immMmm-. 

f[q I ’(.l-qy-^=q f a-q) N ~ y (2-90) 

n=I 

n*, y =Sx„ x„=d 0 

n 

<0t£ y = 3,51 $'a WX!,x 2 * •••»xn 33?! fifciH. o’^MfSL <> 

9 >(l 




N 

;y 


N = 50,q=0. 7 


@32-9 0f/Ko 



B 2-9 — 

2.8.3 
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JPT: 

P(Y=y) =PCy) = jJ^-jlT^ (2-91) 

> 

j 

2.9 s&aimtim— 

mvi^m x 

P(x,<X<x 2 ) (2-92) 

«). &*«Wffia»(/«//)^,*iS*/»(x). ftTtH*XfcA*-#j£ 

K|BJW«45.»ffJttH: />(x)3:T x £&^E|S]±ftt£*R# 

P(x,<Xs£x 2 ) = J%(x)«£r (2-93) 

Jt,<X<x, ±&ffi.3P4 X&A&'MXIS] 

[ p(x)clx -Lc x <X<x 2 (2-94) 

J x i 

«lmw$W5S: 

p(x)S&0 (2-95) 

H^«w®a»^ji«E^,j9rW5iir^wx,.^MRrw(ir#ji)(t i a, 

#!in,/rtx,jOJi£»BML$# X fq y m 

£«**a./>(«)£fa *» w^Tnff^Biw.^ 
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■■■ J IQ1X L' EX! Y V A N L IJI Y ING YONti 

p(x=x,y=y),{a*«ff]^rwTf-w 

P(xi <X<x 2 .yi <y<;y 2 ) =J$.x, !$=,, p(x,y)dxdy (2-96) 

P(x, <X<x 2 |Y=y) «Jjl Xi p(x|y=^)^x (2-97) 

p(^i3-)»3i.B^ y=j Bawiws. 

mm* . 

Ht$)|^^Jifi^'f-t(marginalization) 0 $J#n. />(.y)nTm$l p(y,x) 

p(y) = [ p(y,x)dx (2-98) 

J X=Xj 

^.x, <X<x 2 X 

E p(x ,{f(x)} = \f(x)p(x)d(x) (2-99) 

^(2-99)^ 2. 7. 8 + 

RM. 

s#scHcffMt^tiit*^m» xtT&ftfta.ainaistxt p(x)^^#, 

E*«» {/(*)} £/(*.) ( 2 - 100 ) 

o S=1 

>X ^iXp(x))^#f#flJ6(j S (Monte Carlo)ififDUft 

2.10 

3# 0 
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2 . 10.1 


#^ffiMft/>(y) =«(«,».y 

• fc a ~b t.tm ,%n , 0, 

f r(a^y^b) 


p(y) = 


o(Sffe) 


(2-101) 



@ 2-10 


b 

P(a<Y<d)=\= J p(y)dy 


^lRtSDSi^(2-101 )fn^(2-102)5}ci1 , i r : 


( 2 - 102 ) 


(2-103) 


m&mm m u eihhscK ), m - 

a ) rt „ wn .^ jn ^ b .. 

y*Y 

[ r(a <6 H c < y 2 ^d) 

p(y) ~-l (2-104) 

lo(Xffe) 

r ft: 


(2-104) 


b d 

P(a^y\ d^b,c^y 2 ^d) =1 = J J rdy\dy 1 =r(d—c')(.b—a ) 


(2-105) 
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JlOIXtllIXlYUANt IJIVINC.VONC 


M^(2-105)nT#r|ft{I: 


* r=~ 


1 


(2-106) 


( d—c)(b~a ) 

c)(b~ a)rto 


2.10.2 |3®A3i*t 

jSflffasOTMT o~i ■. 

pM “rwn/l a ~ r ^' <2 - 107) 

B§&. 



a 2-11 xt^i®i#- 4 fcWi 9 te+*A.aifc^*« 

2.10.3 

R#r4)**i££££»i*±<BP -°o~ + oo) y MfigHftmM 

P( ^’ ff2) T^H~^ (3 '~ / ' )2 | (2_108) 
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a 2-12 

K. 2-12 *£ia»ifiS»r«^®fiCaft3lE^iaBI«lMW* 

fw.sp43Mnat6*JS*§@J-2 

AK,/,«*)£*. Hjfc,**y»^^«WKg*.3BP^»OTWiaf^ 

/Kjyl^.o 2 ) =N(/x,<r) (2-109) 

^(2-109mMMM Y MMMMM&tffft// fq^«T J (^f»r 

2.10.4 


/><*> = (2^ 7 TST I7?eXP i - Y ( - r_ ^ )r ^' _1( - r_ ^ ) } (2-110) 

MDXDW». M fnS*HMs« 

1 4 3 .M^#i&An^:(2-iii)0f^,®M®®fa^ti 

mmmua® 2-13 0?^. 


^=[2,17,2 = 


‘1 

0 


0 

1 


( 2 - 111 ) 


• 51 • 







a 2-13 nw;M»a(£) 5 MH*t+&a(;fr> 


±3£$JT(^J fnx,)j.x,,x, 

0 fmW 

/>(x) = ^ 2 rc) ~ D/ 2 j y jT / l ex P| —^-(x-//) r / _1 (x-/j) J (2-112) 

7F&0HF r‘#Jfc* W5E^$J« D ^^|e]7n#Mfn 0 

A?»w«»^®ttwii6iR.JSffiu*»Rria«F^(2-ii2)a[3i* 

^ (x) = (2tt) p/2 I JI ‘/ 2 JJ, exp I ~~2 (j</ ~A ^ )2 1 (2-113) 

£+,ln*£B/=i. ^-^^M(2^) D ' 2 ,ni 
Wie^ft(2 TC ) l/2 ,MIi(^^(2-113)aoIW^^ 

rf=l , 

/>(x) ^n i ( 2 ^ w exp)—|-(xj-^ rf ) 2 J (2-114) • 

^(2-114) + ,UliR+W«-]5iJi-->h47C»»T^(^fiS^.^ft 

&mmm 2 ,%m&nam 2- ■ 

14 #ttk>2 

r 1 0.8 ' 

« = [2,1] T ',2= (2-115) 

Lo. 8 1 
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$ 2 



m 2-14 — iFlfi 2 

^T/K^J 2-i4(£ 

l?])^f^o §P^:Xi .x 2 />(x 2 Xi 0-12FfW]jfn^f-h 0 


^ xi =3 s^t,x 2 2 jUlsic, ^ xj =1 a^t,x 2 (Hj'tiLl&JSii: o JcOfflo ^IPll 

is ; wftMT .» jix 2 wit ^ H .^ iDffisax ^ x , i ^ w . mmvurm 

^JlfMjlitiEjl^MjMHKWlti# />(x 2 |x, 


2.11 


« fnW « S ! JPTJ 5 fw : 

4=/(x n ;a))+e n £„\<^N(0,ff 2 ) (2-116) 

a * nTAntt #» ( X 2 14 

fist . t 

Mfjjfi^fB] mie ) *&& «{i, [3ifli r— tKSf/iM , 

it-'K 

3;=a +z 
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■■I JIQlVUESm ^NI.IJlVINOYONf, 

p(z) =N(m,s ) 

p(y) =N(m-\-a,s) C2~117) 

Hitt,MM t„ 

p(t„ \x„,(o *cT) =N(co t x„,o 2 ) (2-118) 

fa^cem 

2.11.1 

p(t\ itn |xi ,*•• ,jn ,w,<t 2 ) (2-119) 

^(2-ii9)s«[igiitfjj9f^j^w«'&*a(#jiiL 2.7. 5m. mnmmi 
2 .3 pu ix,*,^). 

0f^«^W#^M3L6<J(^(e J ,-, e N)=17p(e n )),ja-«^fntg 

L =/>(* | X.W.CT 2 ) = /7 /»(/. |x„ .w.ff 2 ) = II N(w T x„ .(T 2 ) (2-120) 

»»=1 n=1 

*^(2-i2o), t„ . iATO'M^w,«£Siu, 

inamMMii4:6ti¥^(RrT# , i^*-^^n i96o^)&^iiiwwibj. % 

TffiMJa.imftffl X,t ft»T 1960 

MM1OTM xfnt * 3*3 

: 

/>(f]960 I Xl960 , X , i) (2-121) 
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. /■ . I \r . \ Pi ^1960 ’ t I X 1960 * ^1 /n mflX# 

p(t, 960 |xi 960 ,X,t) —- J(J\X) - (2-122) 

p(tl$60 I -Z")960 )iI/> (t„ | X„ ) 

/j(f)960 I -2"1960 'X,t) = IJp{t fX) ~p(tl960 I -^1960 ) (2”123) 

, mat w ai ,mi'jfiiiiji®*w. {bjm,£ 

a » fn < t 2 

2 . 11.2 

i 

*BS-n suing!! (ai ftl <x 2 W, 0r 

g wm . tM § io g ( y ) 

fln # TO ^ 7 j ^ 5 £: 

logL= — ^log 2 7r—Nlogff—E (/„ —f(x„ no) ) 2 (2-124) 

u Z(J ri — 1 

ffi /(x„;ai) =a/x„ 

TW ® 5 *: 

logL = — ^log 2 7r—Nlogci— ;A S (£„ ~ oj t x „ ) 2 (2-125) 

£ rt = 1 

=\ YjX n t„ — x^rjw =0 (2-126) 

VCD (7“ n—1 

l£j^(2-126)+*S3?£)i:.«» T x, =x:ai,SlttScfn^** O,BP 

VCD 
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■■ tlijivi.f Xtxv S^LlJIYIMOVONf, 

~*T ] ri xi ] pi 

x\ 1 X 2 U 

X= = ,t= (2-127) 

... ? ... ? 

_xJi J Ll X N J [ty . 

«TW^fi£X^,|s]a,Sx„x„ r a; 0lW^l£X r Xa;,^ff3 

w=l n=l 

ig#»: 

^^=-j(X T *-X T X«)-0 (2-128) 

<?a> <7 

»*i£ifciS + M <u.WW»S®ffeffi«3H£j*: 

a> = (X' r X)“'X T / (2-129) 

asfcji a. MS* . * T $« * 2 M j£ (fgi5 0 > =6), ft in 

0,PI1U^3# 

^ = --+-E(f„-x T w)=0 (2-130) 

da a a 3 n=i 

a 2 =^S(/„-x T cS) 2 (2-131) 

i\«=l 

S;(2-i3i)»#Wi*JStM.H*«$*ttSfiSf^Wtt^ra«IS. ffl*SP$ 
^0t.^TE(4 -xw m=?u-x&) T ti-xw),=?%*-. 

n = 1 

<? =^S(f r f-2r T Xa ) +a» T X T XcD) (2-132) 

i > n=l 

nt*h a btmi& £=( x t x )■-* x r ? aft i2-^^ : 

?=jj(t T t-t T Xch) (2-133) 

2 . 11.3 M.sKVAtKM'&te J&. 

2.2 2 

ft. 2 

fto mm&T Hessian+ 2 Ifr 
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$ 2 

Hessian 

2 Hessian ^|^n!li(ii£i^(2-128)^^c 0 T 2fc#ft,AU!ff& 

Y^T = ~X t X (2-134) 

cJ(jjd(o O 

^l^^4TSHAT-^«)^(2-17)ffi(2-18)W 2 lift. 

-\z T X T Xz< 0 ’ (2-135) 

(7 

*„ i:i:*t&7s#ep«7i#fij&JSL sm#x msea. 


(2-136) 


(2-137) 

^(2-i37)^-7«^(^m *=[*i ,* 2 ] r 

z T X‘ Xz =zf Ex?: +2 ziz 2 Sx.iXa +z| Ex* (2-138) 

i=] i=i .=i 

z\ 2xa +z 2 S4 >2 z!Z 2 Ex,]x, 2 (2-139) 

i=i i=i i=i 

feX ya =2,x n ,3/, 2 =2 2 x ,2 ,^SitA^(2-139) ,# 




Sitt<x T x * 


x= 


r T-i 
JC\ 


'xii 

Xl 2 ' 

f—*e>4 

H 

_ 

X 2 1 

X 22 

J 


J 

* 

* 




_T 

Lr.vJ 


Xni 

X.V2- 


x r x = 


r K N 

Exl Ex:: X|2 

i=i 1=1 

,V JV 

ExaXfi Ex?2 

Li=l i=l 
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(2-140) 


■1H HQl-Xl tMVi; ANLIllYI.MGVOM'i 

S (yn +y %) >2 S3;,, _y, 2 
1=1 1=1 

1 ,# 

(jya -^.a) 2 >0, BP yl +y% >2y a y a (2-141) 

y» =y a ,WLxa =-r l2 

inSJTfft* i,y 2 n +yi 2 > 2 yiiyafo±LM\iM.WLMlkW$®m&-fe 
Hift z T X T Xz Hessian 

*M{to 

^^=^-4 U-Xd>) T (t-Xw) (2-142) 

«^cr <x a 

1Sf<fc^(2-142),IS** 

7]og4 = _2iy (2-143) 

^ ff 2 

±^(2-143)tI/h7?.Si«:7^^fWMo 

2 . 11.4 

«f5w*ji^:.(^<2-131))ftAXt»flH^li^(S(2-125)),#PJT** 

immmmm: 

logL = — y(H-log2jt)-ylogff 2 , (2-144) 

/(*;«o)+*£i4gp#* 

*/v«/(x: a ,),ffiK*mn«#ig«fM^ 

M$JM£— 

fclin.atTIUs* 100 *»jg, 

SI 2-15(a)^0^ log(L)fii#£ 

100 #»«. innsmiTJfffl io g a) 
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$ 2 #/#lff¥3Sflliatfe 

-¥W^£ittM(fcksn2oi6^). ffl2-i5(6>a^r , 

mn&MWkm psw . 
m=f o 





2 4 6 8 10 |g80 1900 1920 1940 1960 1980 2000 2020 

ZmAKt ¥ 

B 2-15 *-f loo jL*a.&4tm$$)££j£tf>£W 

2.i2 

2. 12. 1 ^«t1*i1-6U^ D ^l 

SrWfcii 

&w$fcs«. ^na 

£ja**JWffiP?IX£ « fPcr 2 

i n = wo+wiJ" n +e«e n ~N(0 ,c7 2 ) (2-145) 

*«££#»<!* «o = -2,u, =3,S.»i^^r^a 2 =0. 5M^fnHE^ff 
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■■H ) I y I X1 1 K A IY U A Ml. I i IY IN C. V O N G 

m 2-ie 

2-17 10 000 R^mmvARH-RmuTm^iM.u , 0 m 2-17 £ 

wo maim 

iknm, mw ioR^m^wmM^mmm2-i8^ 0 




fO, 


a 2-17 mt & 10000 u> 
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( v ±: & £® 1 Aft ) 

KMUfuraT.^fns^rffi^ffiatfftb««& &j 

2 . 12.2 

*TEa—£8S*.SfcM'3f 

t„ =cu T x„ +£„ (2-146) 

g—^E££.X*iE56##MI8MLM. &— 

/>(t|X»o>*a*) = II p(t„ \xmi<?- ) — II N(ou 1 x„,o2 ) (2-147) 

n —1 n =1 

£ 2 . 10.4 

® J * WOTffi ? S . 0 r 

/>U|X, tt ,,<r 2 )=N(X <u ,<j* J) (2-148) 

siir .«&**£#»£«» w^ito iiiiit»(ja2.7.8^)BT^#^fn^»i 
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(2-149) 


Mi H Q I M J E X1V U A NL IJ fV| \ G Y 0 N O . 

EpUlX.v.e 2 ) {a* } = \d)p(t | X,CUiO Z ) (it 

'■>& (b=(x T x)~ i x T t ft Ajt ( 2-149 
E pulx . UI jAco}=(x T xr l x T \tp(t\x,u>, 0 2 ) dt = (x T xr'x T Xai=a,(2- 

150) 

/>(HX, w , £ y 2 )=N(X w ,^D,0ftUE^^fiJ|®«*W^M{i^T 

in W , H nl flgMifcJjEM'h o 

£ * tti+4 5 

< 2 )in. 

. wwi iisja* je , itrjif jc- 

^asuaw. win.±AttsJw«*i : F<i*Lffl2-i7),«jiit* a , 1 ,#a«„T», 

2. 13 9iai1Itt$51± 

ioo*&teH*iig»sw8. 

^fnwatMtt.sp^a^BinriBtkJR/j'. to m #tfn**isi £, & a ni mm it 

njWFSMSfWfftm *« . 



% 2 


Ep(t\x.*.<, 2 ) {tw } —Ep(, ix.^.o 2 ) { at } T x KW —cd'xmu (2-152) * 

, ff L ={\mathop{\rm var}} {t >rw ) =E pU {*L } — (£W,«,.„ 2 ) {*»» > ) 2 

(2-153) 

*« =ci) T x_^A 

} Ep( t \X.*,J) { X trlL WOJ X rlrtL . } J jtru-UXl} X new ( 2 “ 1 5 4 ) 

var{t lrw } =xL,(X T X)~ i X T E Mx . m J ) {tt 1 }X (X r X )~ 1 x trw — xj^axo tx^ 
(2-155) 

var{t m ,} =xL(X T X)- i X T tfI+Xwa T X T )X(X T Xr l x^-xi w u X o T x m) 

=(fxl rw (X T X)~ 1 x rrlL . (2-156) 

t „ru =xj rw ( X T X ) ~ ’ X T t =xL l W 

a 2 nrw =a 2 xZ w (.X T X )~ 1 Xw (2-157) 

*^(2-157)^. ( t 2 M&.MTOmi+fta 2 

2 . 13.1 

BH 2-i9( a )M^T^s /(x) =5 x 3 -x 2 +x m& 

*iooo a. 2-19(6 ),go, 



(a) (b) 
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J 1Q1 M» £ X) VU A. M IJ m No VON a 



B 2-19 

(ii:a A*W48t#|t»b,c,d 

a-Mwaa-H-g 3 m e 

vrmmttvnigk & «wto)*ffi^. 1a 2-20 m^t 3 01-*q 6 * *q 

««(«&)#» r ^ wa » ffl . ft 6 Bfr « iat .» 3 iUfis ^ TTOa » w^fistt 

30 
20 
10 


-10 

-20 
-30 

-1 -0.5 0 0.5 1 

(a) 

S 2-20 MJMffl 2-19(a)d, 
COv ( cb ) 6 t iijM&'fi 
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,2.13.2 •fcrt-m.tfjmsg.-m. 

ft 2.12.21T4>.«ff]tHITttTms MJftM, «JWafflffl3tE^rit /.aI 
X,a ) ,ff 2 )=N(Xa>,ff 2 /)M^iS.-H-^nT: 

<<&K=E*, U) { (X T X)-'X r f} =^=0) (2-158) 

ft±i£i+£ft,SfnfiffflT * MigifcSCtf = (x 7 x)■-* X T t ),j@5#rBfitn 
M(rt»*a{t#T*JW(XaOM#tt. SHt.ttitCtci 
a». &ma,thymine *bp ft 

* = -2. 000 7 ftl &, =3. 000 8 MTO 
JC£® i® 0 - = -2 rn coi =3 0 

wMMMM,^(2-i33)ftff 2 M3ii* 
o 2 =jj(tTt-t T Xco) (2-159) 

E P (t\x. u J) {? ) =jjE MX , a j ) {ft) ~E pU \ X , a j, {« T X(X r X)" 1 X T «} 

(2-160) 

frffiiMlEf£fSITJ&in « r MfcifciS.iB** ft &Mt T At. ^ t 

fAt m#jm 

Z~N(//,E) 

E, u AfAt)=Tr{AT 1 )+[x T A [ x (2-161) 

n^'Trommmm^tn&Mm-mA^ivC&Mft-fifit,#* i N ji- 
^JVXNW#.^|^);^-^,A = X(X r X)- 1 X r 0 ft / z = X w ^E=(t 2 / n ft 
M#'lf»T^^M{t^A^(2-160),^Jffl Tr(SA)=STr(A).TrU N ) 
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■1 llQJ.VUliXlYt AMLU1YIMC.YONO 

E fi , t[x , a j ) {?}=c^[l-jjTrCX(X T Xr i X T )) (2-162) 

Jffi Tr(AB) = Tr(BA) x 

Epuix.^ 2 , {a 2 } =** (1 - j^Tr ((X T X )-> X T X) ) =* 2 (1 ~§) <2-163) 
*^(2-163)^.DJi#tiH6(|^f[(X 4>W^Jft). 

E,<,ix.„.» 2 >{2 }<o* (2-164) 

#^ 0 0r^»«ftwPw 3 F^a[*o.226 4. M%m?=o.25 0 mmvm 

xtT& / h« : F.D-2,N-2o,Hiifcafnaiife±Brwft 

E*,iW> {? } =0. 25 (1 ) =0. 225 0 

D/N$/j>.D-jii*iasw.<a^ff]TOi#*N. tEx&m^mr^umm n 
hk 20 i^JinfiJ 10 ooo ftgift, WiS*n,aifett^(MI^)&^ft 

^(^)^KIfiIllTI$^ =0. 25,in IS 2-21 0f*. 



® 2-21 
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% 2 

<r 2 =jj(tTt-t T «,) (2-165) 

^(2-165)nT^* 

Jjt =jj(t„-x T d>i z (2-166) 

iP^(2-l65)tOTa,fi<i*$^#ca,# 


2.14 Wfemz 

<h<js*Mo */Mp m&n-m 
mX'kn^- 

&, w. n\m .. m 

se.ffi«mwfflWR»*#*±W3a#f«flE3iEaifi«>h»ig^±w*$ 

Mo 

2.14. 1 

lEatto mn 

. mAmmmn 
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■■■ J1QTXUETI Y'UANt iimNC.YONU 

(l)ttit^ii^(Bias in the estimate) «^igiflM*&:£Tjl|SBW±M3lRfc 

*#HiW, HJfc3tfTift 

Variance in the estimate) s 

2.14.2 -tt-vt-m-yt mjs. 

«^nps). xm 

mm x 4> * is] w a j . mm m . ztat . - #&s w && ^ Ji, is 

Jg#£-5fc»M«*2H|f D,£££T X 19 

AW«4stfci09^WAM«EM). tt* D* A-IE09&&-S 
0!l.H*£7&m**E¥ o 

x %m^Km 

S#M f,X~* 
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$ 2 


{o,i} rt »*?»m. 

.fmS^atoSWTW'hlHIH. 

d)^f m.h mftMM'mmtt 

S W#^««^(sample error) 

it s ^#r£#jt£#ll. 

£l£:fgi£A ^fB»g»/»»lg#^S error, 

(A))* 

error, (/i )=— S5(/(x),/i(x)) (2-167) 

« x6S 

^+,n*S + #$M»*,ffla(/(:r),M:r))ft /(jr)#A(jr)fft* l.SJB^O. 
«««^(true error) d ft 

j£j£:{gi&A ^fS#iS/ AMD ftX£$i£$(Eil errorn(A)^ 

S)JP!IDMIttl«^W$: 

errorn (A) = Pr[/(j) #ACr)] (2-168) 

ieo 

iiM.ie# Pr d ±i+jr, 

ifD 

errorto(A),H*ii*ft^** 
errors(/i), 

'EflrI&fctt#*#* S Ji^fnjSff^WWo ^U0fS#ltW±^|pl^lftJi“er- 
ror s (/i)l£'fpr#@S±il^7Xt errorn(AXft'ffrit?”o 

2. ftflHg&iftftftftKffl 

***“eno rs (fc)ftM#e*±liffi7Xt erroib(A)Wfiith”»|5I®.5fe^ 
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(d#^s nwtt®s,w$w DManmns.® 

M.M'#RWffi=Fh; 


(2) «^30; 

(3) fgi& h i£i in - / M#$J±?12T r ''MtiJICf#|#P,errors( h ) =r/n)) 0 
(1) 'iS^T Sfifefit ,§> ftfj iS * errors ( h ) H oj £Kj fit errors ( h ); 

(2^-m 95%WTOtt,«»«^ enorsaJtt^TffiWKfilrt: 

errors(/i) ±1. -m°B.<*» 


«»»##* Sfr£>i-40 +#M.#aea* ffifflKMie'iTr- 
12 y H§i£„ &#,#*^$fcerror s (A) =12/40=0. 30. 

enoito(A)W*»tttttf-BP^#^«* 0. 30. M^fH* 

S',error?error s (/iSf l t , lt5J , Jfl& 

40 S, ,^aSSl«I 

Hilt,Hcfn#Jlt:Er0]^* erroruC/ilfi^J 95%g^Efa]ftit 0 
$|<t>,r = 12 |nn=40,^Sg±^,95%a#E|H]^; 0. 3±(1. 96 X0. 07) =0. 3± 

i 

0. 14. 


1. 96 JiEtl 95%i*-gf=M£M. feX z N ^Jif» N%SfIKI5]RtM#ft. 


it» error D a)#J NjtfafSKfg«MR*i£5fc>&: 


errors (/i) ±z,v 


error s (/i) (1 ~error s (/i)) 


(2-169) 


&+,*n 2-2 

n 2-2 jRffl w N%sfi $ m w ** n 


n% 

50% 

68% 

80% 

90% 

95% 

98% 

99% 

tiz N 

0. 67 

1. 00 

1.28 

1. 64 

1.96 

2. 33 

2. 58 
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$ 2 


HiHMEft error D (/i)fl<J 95%gff E|bJ;*J 0. 30±(1. 96 X0. 07)(^^ r- . 
12,«=40),PlW*#|^#1f51T 68%gf=E|0]^ 0.30±(1.0X0. 07), R;t 

vixmta 95%jwiK(^,H*®<n*/j'7» 

5jc em>ito(*)*AjlfcKffltt«*. 

^■^;(2-169)M^T IkTfe errors (/OSSlUAfi if error D (A), ilPfnJi+^g 

ifKIU(BP«^nR). 

i£o 3E^30 -f- 
Wm#R error s («***itt 0 J$ 1 

«error s (/i) (1 —errors (A)) ^5 (2-170) 

2.14.3 JMfcSLte-JfcJffli 

TOtta*1ir. 

$&= d >NSirw^,®ia#^ s,mi^mt 

errors (A), */]'* n 
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HB I IQ! X V fc X IVI • N L r J 1V ING VON G 

errors, i (A)«Mfi,'&Jfc& ; f *EI s, mm 

+ S#1#aT,*i^#W$lftW»tiJerrors,a)”. 

Btf/L^EIKrandom variable),, —flSHfiftT* nf y h^TBfiM$fu 

,+,w^ifc. rsmmbp ,43. 

£ “t"J& # (ft BS »SSJ it Bl tn.$# errorsi ( h ), error S2 Vi ) , 

•••,errors*(A)„ 

^ A **ritfc,i£fflifeWF£«iqffl 2-22 0 rfi*M$Mfr. 

(binomial distribution) „ 



® 2-22 w=40,/>=0. 3 Bttf —■*%&&% 

p &t,£» 
£*WTW#E*g»£jiC. 

P(r) = , / ?! ,, />'(i-/>)"~ r (2-171) 

r\ (n—r)! 1 

(1) X|©rS5||Pr(X=r)i Pr^tH; 

(2) x ezk\ =np , 

(3) X Var(X) = 7i/>(l —/>); 

(4) X = /«/>< 1 -/>) o 

»/»(i -p»5 

2 . nmfrin 

wt w mm, 

tei+MsifT7 0t,+,3®iEffiMWo />,&»««ru» 
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$ 2 

H-iJSiEffi&mfSt r 0 p r/» 0 m, Ms§natT-ft. 

$£ift,£jft- > h8rw*ft»«rfi «**,*«! aiEffift# r 

fi(^osy»),ii>MEiii«^/>fiii«iSlB»n- ftte#amr ftiESiW**. 

lAttit enoito(A)Jiffil^ WlRlII, —tJcBEfpD 
#*«*£*??» a 

W£09tt«4K8«lMKHP /> M error D (/i))o n fttt$M#*jft&a] r ft IE 

Hjfc.r/njffrjSt errors(*). tttt p 

error D (/0 o 

ifefflT*w»ift®i1itiiajEffiWft»aja&n >h#to+ffli£Hi«r«ft». - 

n ]£ error r >( h). 

(1) ^-*2|c$»<ftlftll8!r1i),K»aj^r«}iiB*-l»ta$l:Y. Bfttn 

MY®M^M(®Y = 1 AjIE®.Y=0Sffi). 

(2) *«^ji-ft^K4 ] Y = l »«$&*# p. 

%&„ 0jW;Y=o»A?i-/>. 

'fe Th'S o 

(3) S«i&W n ftA*^«»:lf Wftff .^dt—^3!lljfcBIMWBI«l$ 
#^|J Y ] ,Y 2 ,-,Y„,^7?^» ftM+HjSEY^l Wftft: 

R = T,Yi (2-172) 

* = ] 

(4) |«#l$*J? Jfc#£llr rftJEffiWffi^)*— 

%l u. 

Pr(R =r) = , ,” ! ,, ^(l-/>)"~ r (2-173) 

r| (??“r)! 

—«ftOTtt»tflSftr ftlEWtttt4*.tel0liSTfc3 , » > H* 

WJWtS^ailr ft^MiSMW. • 

3. 
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■■■ flOIXlIEXlYVANLIJlVlNGVOMi, 

feXY nl yi , - , $H{t (expected value)E 

Em = ±Pr(Y= y i ) (2-174) 

1 = 1 

m\uin% y mut i o. 7,mm 2 wmm 0 . 

mmmvM y 

E[Y] =np (2-175) 

M^£(2-173)4 

ilif WMsKlS. B P'E*8i£7Bi#L$* 

:RS #15:11 Y variance)Var[Y]^J 

Var[Y]=E[(Y-E[Y]) 2 ] (2-176) 

y <tyo 

Y MftfiHlllstandard deviation) a Y ^ 

a Y = v / E[(Y-E[Y]) 2 ] (2-177) 

£bs#l$* y 

Var\X\=np(l-p) * (2-178) 

<rr = </npa-p) (2-179) 

4. 

errors!^ )fqJt^^$error D (/i)^|B]nrf^M^Ji^^? 

^^(2-173)4^^—errors(/i)ffl error D (/j). nj# 

error s (/i) =— (2-180) 

n 

error v (h)=p (2-181) 

^4>,w (-/> 3/iAD £ 

|£tH£ 4^ errors (A error D (/0 W-^h 
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$ 2 $/tiLft$gsaratfe 

ttiti(estimator) „ ills' #3&WI3£#l$ 

fto rmmn 

fSi M ( estimation bias) ^ it IIW $1M {11^ 31^ # {t £ |b] W 

Mo 

E[Y]-/>' (2-182) 

it #111^7 O.^fn# V %J p fr^UHtitlKunbiased estimator) „ 

y E[y]^ife 

i&TF P° errors(/t))^5^7 error D (A)M—t'^fiSi'feitii? 
blttHfr.r MJBMfciip. Hi*7 n r/n 

f$! errors (/OXt error D (/i);£'(f|f£it.flti§: h 

itl^Hi*—inductive bias)#! fly#,, fStHSU 

m, *^Wjej8L,J9r 

ffiJnftWa-TOUt.'BJlt »=40 r-12 >Mt«, 

BliT.Xt error D (/i) Witfli'feiti*) error s (/i) =r/n= 0. 3» 'feitt l 7 ie :t 
^Sfr^M-S* « *-#». itl r 
(2-178)^(2-179)# npa-p). M p r/n 

Wp o r 40X0. 3X(1 -0. 3) = 8. 

7871 «=2. 9„ l^^TK errors (h) =r/n 4> 2. 9/40=0. 07 o filg 

£.®£5PJM errors (A) 0. 3,|^£Mj37 0. 07 „ 

—r ''Haile*errors (h )W#®^^7 

<W (/i) =- =*J p(1 - p) (2-183) 

* « v n 

r/n = errors (/i)3fcft# />: 
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■■ JIQIXI'FXIYUAHUMY INGYONCi 

,, s - I errors (A) (1 — errors (A)) 

0<rror ! (nj^J ~ K/iTlOi) 

5 . amKfg] 

IlKfilMia p WK|bL 

n=4o r=i2 y Hf®.TO$c 

KI'h] 0. 3±0. 14 fl- 95%WRliH4^|t3;«®^ error D (A). 

SPM^# error D (/i)WgfsEIB]? ^ errors(/i)®xiA—^ 

a-M^^tt^error D (/ I ),#0.^oTfti^(2-184)it» o 0jlt,Ai+» 
95%*^KIiJ,R1ISlftta- > Hai4Hierr 0 ito(A)* I t , ^WKtlI.'e»JE«JEm 

95% 0 erroib(A)WKra,ffi 

error s (/i)4&/E^r 95% errorrj(/i)W 95%W 

tfl.zc$|A'£lffl errors(/i) W E|ii] W A-'J'' ° 

*fA££W Nfc,fcmmMA«te£&*W *fA 

2-23J5Jf*,IE&#M-A^«, *3£i$tt ^ ftftftiiga *f A 



® 2-23 

* —-E^AATffiWW 

MS®: 
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$ 2 $/#lgg¥3£fflil3i& 


/>(jr)=-=L=* _ ±CV)* (2-185)* 

yw 

jE&OT * ±ffi&sS * MM>h#» /* ft a ^£5j$ £. 

SpMW/M X M ,M : 

(1) X*A®(a.«to«E^*f/>(x)dx» 

a __•——' 

(2) X WJWaffl^^fiECaD =//; 

(3) X W^Var(X)=<T 2 ; 

(4) X = <To 

N^w*M*wKraw*/h. ait*#* n %g 

faE|0lffWm6= ^IS±,ffl2-24iE*a#- > hB0. ffl 2-24 

). IS 2 - 24 a % , 4 i T# 3 $f Zaso W—^K|b] . 




a 2-24 l^jt*^na 

Ca)6 80%*iTJ®T.|Bltn.$*fifi[ ; f jR«(K|llC-l. 28,1. 28]£|I] 0 ft 
,t *0.80 = 1. 28,^ 10%*ita*jSAKfiI£«.10%*AKRJ«fl|. (b)£ 
90%®f^JST , 00 , 1 . 28]_h 0 

&iJ5W;i.in#l8itfL» Y ff 

Wlf-MfiLv WN%W#l#iSAT15WK|SI: 

/aizNff * (2-186) 

y±z„ a (2-187) 
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JIQJXURXl Ylj ANI.IjIYIMliYOMO 


t 5 fe.rtlT errors ih ) 3 S^X^«, 

error r ,(A),#7t.M^^(2-184)^;^,®fn^iI^T£^^W#^»,-IM 

N%af=Efi]o Hj«:,#errors(A)W^lilO#7t-^^AIIJ^(2-187)^ 
mm&( 2-i69) +*raiMHK«w N%m.\mM% 


errors (/i) ± 2 n 


errors ( h) (1 — errors (h)) 


(2-188) 


(l)'fe'H' error s (/i)M##-^ a Bterror D (/i)errorsC/i)(#nM. 
^(2-183)5lK(2-184)^]ffi^) 0 

n^3o ]& ?ipa-p) ^5 

T».ilrt|B]gr error 

2-24(6)) 0 

—L U w 100( 1 -a) %m.\t El’S], L _§Jc± 

IfM 100(1 -a/2)%#fsEl'H],(slBttlloT#.Hi-^±^UMT^^ 100(1 - 
a/2)%Bf=Ef0h iiMaJttfiE^jt^fll^^jeEra^Wa^. 
M^MAig 2-24(a)+*M»»#Mfc*S, a /2 Ji&Affl 2-24(b)tfj^Kf2 

* A /*£ r =12 *=40 W&'N&J 

f. iP±0f^.'e#a—95%*f|E|B] 0. 3+0. 14. ^4* 100(1 - 
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% 2 

a=0. 05 o Hitfc.jfMfflW±MPJ, 100(1 ~a/2)%= , 

97. error D (/i)jR^4 0. 3 ±0. 14 =0. 44,errors 

mtttk error D (/i)±W^ffilJ^$ja^fckffi/Ml ! l < ])«fJjii[^^TOWgff/to 

2.14.4 *kz5-i& 

error D (/i) „ 4fflPJ 

& />-^Jerror D (/i)„ 

(3) $£&mi+M y M«E4t^ D v 

(4) iiil#tt^{i LmuN%S:in Efo],Wtt&'MS D, MMII 

$**f N%#i£&A L fn u zm. 

fs mmmmmm toirtefem $mm jin #t»^ 3 *# a m i+ra @<4 

4. #5fc«m5itifctttf-a!ifcW-^®5J«#. ttiS!* + 'C'tt PBJta (Cen¬ 
tral Limit Theorem) „ 

+iC.'«Rjea*ffiik*(irK(««i#w- > h*2|5:«ig. ^murw-mm 

Ate it y, in 

Mnw*M#)iMY;,= 1 £Y,(to n *s»{griitaiiiiiE®Wfck^j)o 4 am 

n i=i 

' Vw 

£X$PT» 
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■■| lltvixUEXlVL ANLlJlVlNtiVOMG 

^mrm% <t 2 o t* M_a# 

-Jn 

^dZH (2-189) 

a 

-Jn 

MYTOfiC. y^h 

(im nTM^JlE&Mo 

to itii- jfifw W IE & M Jrm , OT ffl ^ (2-187) *if % Rin E fa]. 
-^fflUfMawjjis n >30 iu®w$TOfniEMfflT 

errors (/i) ®iAM—<, 

2.14.5 OT'1'miS:t#i*^-/si6l3^-#- 

»*,. fiafci >h 

Wttttjfctt#0jw#* s, ±»«,ji. k nt 

0HW#*s 2 ±»«. fi£3?tttraw^iftAm£««¥raW£#: 

> 

J=error D (/ii) —error D (/i 2 ) (2-190) 

d%ftffim0$os,Tm%fex-teT+mo a&.&mnna## 

d=eTTOTs l (h i )—erTOTs 2 (h 2 ) (2-191) 

a d E[d^=d 0 

$Jhi fo « 2 ( tk®t|1^30) ,error S[ (/i, )fp error^ (/i 2 ) tPlfiftllSIAJEjS^^o Efe 

error,, (h t )^P error^ (/i 2 ) ® 

(2-i84)i*E»aw^ffWifito^. 
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W> 2 $/«i8¥33saiai& 


, errors, (/ii)Cl—errors, (/ii)) errorsj C/t 2 )(1 —errors, (/i 2 )) 

Uj ^-1 ---- 

n i n 2 

(2-192) 

N%Rimd±z sa , Mum <& m&u&.d wmm 

N%wim mfSit* 

V errors, (/?i) (1 — errors (A, )) errors, (/i 2 ) (1 —errors, (A 2 )) 

- 1 ----- 

Mi n 2 

i (2-193) 

i 

Itt. 

2. k 3 

0 . ft /i 2 &ffiiiiMfti 

#^±Siawill«.M4- > h#*S(S^i!liS: ; fAi »a 2 )±»«Ai ftA 2 
^ffl^(2-193)it^af=K|B]li^iii^pI^SMo &#.<? M*r££3r 

^=error s (Ai) —error s (/i 2 ) (2-194) 

ftS 2 &t,»<3 4 , W*‘M#^T^(2-192)^tHW 

*#«M*ffirKEHirth tkiPTffiWISia^errorbCA,) >error D (/ l2 ) WnTffitt 

ft*2 »#*««*.« 

100 Si ft S 2 ,#Mil errors, (hi ) =0. 30 _§. errors 2 (h 2 ) 

=0.20,mitkM&d%0. 10. S^.iTftlg^WISItttt.BPffierrorb^X 
error D (/i 2 ),fl}^ftii§|#l>IJi*#fftJt# 0 d =0. 10, error D (h x ) > 

error b (A*)WIK45*^'>? ^JtfcftXM.£nf5Ji+3l£ 3=0. 10 Bft</>0 
Pr(d>0)(%=F d rtd WaffifiiW* : F0.l 

A'W%d^Ki$-m&md<d+o. 10 Md 0f®M,W#*l>M 
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■■ Jf.CjOv IjE'CI YUANl UfY-IVQV'OtlG 

d<pa +0.10. mmi &,M Pr(d> 0)^T d 
fa] d<fia +0.10 d d 

</ia +0. l£ffl:£(2-192)BT 

d<fia +1. 64® (2-195) 

igiltjE&MW#-iJK|0lffi^fKlSfggJi^^B'B? « 2-2 pf#,^T 
JijfiM 1.64 90% [ft MM, HjltS^^fJJElal^W 

95%WSfiJto HHt.^mSPJM^=0. l,error n (/i,)>error D (/ l2 )W|gt$^ 
3/0. 95 0 

ft Ain l£ : fic3l(accept)“error D (h j) >error[,(/i 2 )”i£— 
M.Sfg®* 0. 95 0 &-m&&nT3ti£2/:«ff]M(reject)*t£fgi£(« 
^^ffxii?:) .ui(l —0. 95) =0. 05 ftMIrAA-isignificance leve), 

2 . 14.6 

L a 'fo Lu ftttfMAJiMt 

iw*ftfgu&A:to 

M>ft£i£3?tti+ft#$o fg^WL A ffiL„ 

£jr¥irft-#£-a 

WMtt: 

E [erroro(L A (S)) —error D (Lij(S))] (2-196) 

sCZD 

s^D^mmtM.&&mmfrft d A«ft#As ±i+g. 

•ftJi^»&L A fOL B 
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$ 2 


mummim -MMiBTitiiti= 

error T<) (L A (S 0 )) ~errorr,, (L B (S 0 )) (2-197) 

±^^(2-196)Wif»WW-tS^W^[Wl 0 nVcftiimm error t 0 (/D* 

jfim errors*) S 0 ±,M*Ji£JA 

m*D ti 

ttit ®l b 

(DMfflsiD, frmf&k^m±sm*m3i : ?mT,,T 2 ,---.T t ' n 

-X'hM'J? 30 o 

( 2 ) 4 - * hk i m k 

mm t, s,» 

S, —|D„ — T, | ;h A *-L A (Si) ;hB~-L B (S ,) ■,S,*-error Tt (h A ) ~error Ti (h B ). 

(3) ig|lHI*,&+: 

1 * 

A; ,=i 

iM®ft § nT^m^it(2-196)MWttW- y htti+o 

E [errori/L^CS)) —errorD(D B (S))] (2-198) 

iC;D 0 

fq^(2-l96)4>S^M^^f0],i«-&<]^'J«T^M{iWTf-»Ji*nTM 
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■■I JlOtXULXIVL'AM IJIVINCVONC 

m Do d m±nn. 

ttif^(2-198)^MW.iV%afsK|l].TO5^^ 

5±? n ,*_i5* (2-199) 

^ mmmmm , issaw. % 

«-V«I^T)I, w '- 5)T <2 - 200> 

i±^,^(2-i99)«f^'ft'tt (M.j-iWMtTfe, wafts, 

£nftuffiW'$'$( *n tiff . § it]{^(degree of freedom),'^'® 

i£t£ W&ft 

#»/ wa^m*^ 2-3+?ijtiio ~&f, 

*n,*-i WfttlfrT#:®!: zso 


& 2-3 HMfeEH / Nt ,Wffi 


ft tiJk 


lit AN 


90% 

95% 

98% 

99% 

v = 2 

2. 92 

4. 30 

6. 96 

9. 92 

v=5 

2. 02 

2. 57 

3. 36 

4. 03 

v — 10 

1. 81 

2. 23 

2. 76 

3. 17 

v—20 

1. 72 

2. 09 

2.53 i 

2. 84 

v—30 

1. 70 

2. 04 

2. 46 

2. 75 

v = 120 

1. 66 

2. 98 

2. 36 

2. 62 

y = 00 

1. 64 

1.96 

2. 33 

2. 58 


( Vi. : S 

TT-»-°°8+,fN., 

,#i&-f *.v.) 



aW'hfg®. &** 2.14.5 

awaftKiw. *s 
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$ 2 


1. 02*f t iiJK 

in*®-* 

mmyi,y 2 ,-,y* a«ii;(2)iMMy, 

WI«IB#?ir£ift. Wn^WMT-ifMfc 

ffi errors(/i)^ / feif error D (/i)0<J|n]@(^4 5 ,Y, ^7 0 ^ 1 h Jil?)#—#-$ 

WS#Wj fc ^«4>^.M er rorb(A)**®^W*Sl<i^). *^(2-198)fq^ 

<»2-i99)i#j$M / hp^^msw y, m 

n#fi*2-3 

Do tw. a-a«3fifl:^rftl6 

1«]®= 

m5feft*59,»ttis t, m&&ir 30 @jjt,^6u s, m&imm 
jH5S^(*+^«R^aRr»). 0itk^fn^r-#^#,BPY, mhkmm 

». Etilit• f>m#ji{£ffliiu. S+Wfiitf-*iHiHi 

#*#£. ^M.nTM^(2-198)fqjt(2-199)^WafgKrB],'EnXMSif 

n — Y"Fr^,>—15y (2-201) 
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(2-202) 


IIQIXUEXIYUANLIIIV INGVO.S'C. 


*?=7 




% t z s t ^ 

^ k jgj &R3c£rt,t 

2 . £&*#& 

mmitirm *.bp mfext? a 

rteiiffl, £tfwraifi^ *;*£*,■ R^mffi%WD 0 ,m*m&)iTmm-£fr 
mwmmmmtm, wj, 

RM»i8#* Do Do, 

^ 2-3 a wti* k 

*i4#*-/oW^4 , .Do tS-PM^Mfia.I^-i fcfflTtW 

m* %-nn-mtfjjm&hAD n 

ffi^®S3E»lfc.Ui»/hMK|BIS0«5W*® o *8£-* -/oU 

its. 
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sK 3 * 


n+ttaTA^ws*. 

- ifi xxmixim^WT m m a r«j. 

ffir&mft - m w Mi *j m teffittim®' 
Ji > haS,tt'eScJRl$ffW»4-.»WSJ*#l#^rit. i 20tS40^tl 

W®»|fiIJIS.ii-||:«ltB»»®**llls^J««f«F.AmAJBMiB*jaa^&if-3r 

1T5fc,20 ittffl*MA¥.**«lA«S*®»^iii,T+J![«l«jKAJBa»®«l 

^Amm«^®fTMWlfl:iiSMAmAflco 1996 ^ 2 ^ ,&HS IBM 

«a e 4«2 wf.s 

BtMfm+ITfjS*^# 1 fc£. 1997 4f^mW3?A#?A^it 


259 ffi.tHfffi**®# 113. 8 lZ.&#Aji3(. 1997 mm&ftVx&QiiniXtt) 12 # 

10 &m. 
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■■I l|QIX1*EXIYl AML1JIV fWGYOsr; 

mztiz&nmw 2 2.5 = 3.5 mt 

4Ht*ft. 2006 ^ 8 ^ SiltS# 5 

ak. tii&ik&m* 5.5 * 4.5 w-Atk^«uttW®»« aw.* 

anr am® pk a^it^x* 2016 ^ 3 n 

«F^1ft5W^+,“W^jSfeffl« w (AlphaGo)®tn i »*»W 4 « 1 

3. 1 

3.1.1 

s^hfw, : • spibx 

is*. 

A^WA®A^Wl.4xio"Xtt^^ll.4r'^A#^7no 

»WWWiiitK*flb#g7nrgififfi5:Sft.^J«*«fW^i»#i5W^. X 

&«hha® ira;,Ain^mm w n 

£—o 

xif t w m a b w x ®a*t ss & # ^. a b w ^ b tt a tii «!bi ft » ^ w at 


®‘‘?li® AtTIWW^IR 27 «?«&»,«£ 66 

©W^H1IKAl|*aGo)*-|fcHttAXf tlSff ,*^«fe(Google))»T DeepMind 
9r • vafrm.AJl • £±*IfttSUSS“*flE^-g”. 
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W, 3 #/Al*MKW» 

ww&b^ roaair*ih.A#s»r#®i5artw*^» 

nTWM3itA©#»W^W*^i)liR. ftjItaWiRWSSIlLb* 

Artificial Neural Network, ANN) 0 l^&iZE^Jir 

Ai»4»#sw»wit^5iJia.MR*xff'ewfirfl:,iiii^«ia. »*ai»w 

ft«S M WfiUtESm ill A® M ia g iiJ&tt, g ifiiRM « 3S ft ^ 

AJIiAo gfci§W».Bt6tt#A^#&3,g 

s&efrj M£im .mm mt& , am#®?, ^nmmmrkr 

H eC ht 

AfiBi^&nfiMMfg&MA HHHKf«aW5fEii-S!l^ ; 3 1 AX#fiW 

3.1.2 

AlffMR^Mf^AlS^ Wt02HMM8ifi M-#®r 

i. #»«$«**#£ 
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■■■ IIOIXUfcXlYL A N U) IYIN G YON l'i 

ntxt. 

#»W»W,#|£W^»A<lfji > Sf:ll!iT*ffi“JK«l”WjO‘fe2EfflfiIt2.HM 
JWf . #SW»rt*J&W#1*-5 

tt3s»*siso±^.H*rfii±^mw. 

^SWiEto,M.M$3KXt3fs^S»AfiJg,WiEflliR»J.a—MSfclllABrWJtt 
XM?£^X^MfiriE5i0iKS']-# o 

aW&W-'hM#®. 

w g ^ g ^ jw* , &a-g»t ra wiin $m)ii , # g m % 

►as«ts»*w»wgffl^(^#*i»). ttsra&w g gsj®ttffi 
^, g iij^ttMxi g mm%m w . 
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$ 3 


2. 

«p/S. 

(Dnisna+z; 

«Hj&»»A«^i4iTiKsiia+zwi6A. &wmtimm&w%i7tzmv}m 

3ft«*iS+ZMftm. #SW^i§Kt9i3fe^^Jl,»^^#L*!lffiFf aSJSfilHSK. 

©a&JfiiSfc 

J..inffl 3 -i(a)J 9 fw. 

©#«3®ietz 

fflj®. BPfMt A^ifSJiattW^ftiniTW^W. 

W*MLtBI§]teie^£xtJ£ME-»#. 



{Aon} 

=C> □ □ t=$ 

•: 

A —O j 
u-o\ 





X — 8 J 


(a) (b) 

® 3-1 #&*&■£• 
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■■■ IlOlXU'EXlYliANUJlYlNOYOMO 

n&im&maih 

mm m±.M&w *&ra $ * M#aa k# , kw a m ? 

-m. im 

(4 )vtitim 

im%mimvt&Mmmm%i+*mtmmmmm» m± 
m . ** gxt 0 . n*%mmm a ^tu w. 

(5)5ai iRM 

*HR* Aff] A&jffil&J* to** is & W A a # to£K+&£!S & IB * tt® 

& >imwnm . ,ft #tm 

^ffi.xt¥a^53iTaaaRa,#gw«&^»iiRWJks^A^fla.ifcAA»f* 

iRW1f«T a ^A»A»ig+llJ&#fiE,£&«ai, ^ifiil a &£&@tt£N 
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W, 3 4E/A 

3.2 

#sra»w»^fi*iifji.tta«F«E-^tt*ffiKjaM«* 0 isr*,*** 0 

#W*H. 

1. if 

#»w^*-#*fS!Sie<iA4baiiR«.»M*^ji.M^si^», 

(1) fg-^-M 

(2) *^iR»l 

ttaw^ttRrwttafts^ 

tfWfi-stoiRJM. sffir*«ff*±i!i4fcBrji0.M¥^A«i@ : ff*iA*aa 
-ifcS W#£ W E^Mtt o 

<3)8Sclgffi® 

m ) n mmmss#®, pj^fift ib , ftiuce Bt)»»» 

2. 

20 M so 
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■■ ) 101 XU EXI YUAN L1JIVI NtrYONC} 

— n&mmMo 

n . mmtm Bwiwriiai. 

(D&mm 

&g zbrimm^^mwiRM a % 

<2)ttgjSlH« 

«#wjiPJWifiiw*#ttawa»T#aifiiw«k &¥*,a^&M£x 

i,?Mig»g &&1EMR g, i*#fct&t&SI?&fBnrWilxiff^ 
aa»ra*»?&tit!i*ra! • zm&m\ Mmmmpjm , M^M^ara 
few^sj >+, w t^S'j a w#fja4t3i7c#fi!Txt^^^M 

W5dtl. 

3. X@W 

20 ttt*B 80 ¥fm*.#SW&MSifcffl&J®£B*&£Wxe«iMi» • 

* am^xe 
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% 3 

m&m w. *r a *iit4S^i«g». $ a 

»1»aT.WAtt:|Bi5SSJ»*W'J+**a :5 Fiaf'J$.ro^S»i5«««M 
*M*#siOAfnw^a. 

WM.W»lftl^T1lll«fP»ffl«.»E#Ta»W1±#aaF*St. 

(2) ¥$Ii 

#fiw»iRia^si*-^K^iSSEE^j&nrw^a-^KSTifT». 
*l,IE»nri£95% 0 ^Jffl^PfifM^J^r7jcTS#Jim«5MII5Ji«± 
ff^#fW«.*f*Ti#WiR»!4£nr& 90% o 

wmsw# w@, #w#&w& mr m wm& «r®it ta *$ ttmu » 

(3) 4k^x^ 

20 M 80 

UXkfJXfg 

Al£%aei#iRfP16ffl,MJi|g«Bi»,MiltzKffi^,*K«a#J.««±tt 

mm& .mmmtim , m* , ®±m\mw\ , % 

\mm®.&MRmmLimm ^ itfxm ^^ hi^awx 
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■■ J M’lX L'l'\'l VL -\\I UIVIStiVONG 

4. 

(2 )£V3ffiakffl$Z 

(3)E^SE*^ 

mrmm, 


(I)fs»rr 

ft&^fe]®+, ftffflifEf3 if &m W# fi #^^,‘Hfafflif 
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% 3 


mmt& 

3.3 ^ti^^Pog^Sfiaj 

mi+.A^AMAM#^ 1.4X10"^# 
nyt,^mi7t^ io 3 ~io 5 

3 . 3.1 

%L 7 t^&m)o m 3-2 

tll6S®ft^il. 4 8B# 
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j t q i x 11 h x i y u a n i i j i y i n a y o n g 





(Dlfflfl&ftCCellbody) 

wji mmmMmMmmm^o 

(2 )^f^( Dendrite) 

(3) f|}] ^( Axon) 

#-4WS5M8*>rM 

(4) 14 (Synapse) 
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$ 3 

15~50nm MI*JK,*fc*fcjte|B]Kt,£ 
*^±*EW#®W,M 3-2 pjfm, &+ft&7Gj:&*i io 3 ~io 5 

3.3.2 *Mfr^^it«>TtrA:*t3a.4»ua 

jfe W» Afs-t; 

M* a Kffett&TG . ^-$t fMs 

tta«j&w#ia»fT##f. 
i. fs J&Mi 4 ^ 

tmik%, #^7Cl, ffilfnMJi—# % fc^iggi. i£ T *ffl 

&(Polarization), #£76 *#&*&£. ^ ft &7t& PJ*h ^MM«ltf, ^ 

M H fete ffe & fpj IE til & ,ffiZ % £ & it (Depolarizat ion). jit Btf ft %ol 6<J 

larization) W*ft4fcfnjB«fc 

filfSB*T#gj£MXM#PKfiJ*a.#£ tgj& A*t 

*b^»T, ^tt^TcW^SS fixiT^R*. 

giliJlT: 15mV. WjBijtW4£fc{fc 

1ms ft 

ItillltiJI- 100mV£^,lttMH*^3?.mMTI^,®PJ#ltfftMfflo it 
-iiefscf^amaw^ite.^w^^-^SE* im S ,js$f3/ ioomv 
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■■1 Jl'QlXUEXl V UANU 1 J rVlNCiY ONG 

3-3 $fzK„ 



ims jg«« 
ifcjfciOL.tt&Tnj* 

nap§MmMM. #tt^M»Aj0c}»i««j*a*,^#ea*8jSf.*^tt 
2. firmw^-^SNSc 

JB£ **©*!ItfiSIII;, W*3sfcfefnM rn t$*ftk. 
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$ 3 #/Al»*5E*& 

—#£57n(#H® 3-4 



—| gftkfflRt |—► teWS 

S 3-4 


0. 2~lms WBtlH 

•^ig.^*^fel!5$ig (Synaptic Delay), 5$ ig . r^ ^ ft* |b] I5ff! 

* a® *. % *»#« a t w 

mma^a/k 

it. 

3. MWi^ 

fei a o a mmmijiM *ehs& , n asp&*k , *f #pfi 

au&*H. 

B^tfaJS^o 
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■■ notxur-xiYi' \sli/iy jngvom. 

am a ms### %. & in m. fkft m £ ti 1 4 s n* # & &m w # » f@.i &a 
gite. 

4. 

#5$ ws?® #U!i, w» a^j& . *n &&&#&&& , $ 

jewnnsftij tn n s s js . 4 »# & w & wan**^ 

isM*tm#]MMt8i&mn. m&,&{°i 

t&tfj|8J*Mtf f±i 0J$l #jgg:. Ffci T-tt^TG^l'H]A- 

Abate*. 

3.4 Axtt&w»«sis^14fl6 

3 . 4.1 

&AI# £M&^#^tftt&*“AhaJ&7G". 

1 . itfiTcwa^ 

stifAffiiiiiiwttgTcesaiB^R^.K+a-^iiibMie**^,* 

1943 ^ll'JJ^ McCulloch W. Pitts *^#f A^W«g7C»^«FttW 

M±i-^fetiftiw m-pm„ 
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$ 3 

T 6 £«££*?»&. 

c A^naj 

(2) miitm AMfrJtt$» A»#ni. 

(3) m£?cM%£ . 

&T£»#£7nfiF4Ah«M«rj&. MMTiSff^ ik£&, ±&&fe , offfl 

ffl 3-5 «t>W#S7C«aw*Hi®fTfflKP^. 



(c) S&Ajmtfcfcffl (d)ttA—tttliaft 

@3-5 

H3-5(a)^ffi,jEJta^i»#gjc^r^*ia»A—#.Ai#gxifeiSt« 

HI 3-5(b)4 1 W^7nW^- > NiA«-^in^^l!fW y 


• 103 • 





■■■ I tQl \ UE XJ Y L'AN LI J1Y flfOYONO 

AI#^W*tfJtein£#^g:rc—#&#—4,infli Oj iU, 

3-5(d)*t*w*#a»3ie*w,a#a» 

2. #gjGW»^«S! 

tE; fti|S:M*S#fi7Ci M^, l Hf^.t Jl'J 

#^t£; 

0j (?) =/{ [Ew,i(t-r# )] -Tj } (3-1) 

5$*. 

r„-£ A$ft fti in M £ JfckBt. M; 

Tj -#a7C> WTO; 

w # —tt«7CiPJi M$ftk£&££^ftftS:{t' 

/()- 

*fW^jfiJSL,«F±^4W«ll*nriifl!i*^ttBtin.!iPJ^(3-i)Br^* 

o,(r+l)“/<[E7- 1 w,i l (f)]-T i } (3 -2 >' 

% s&&. g+n 

Ax, «jT#i=i.2,---,fi,»fcHo > iftTfej tt«7#&3cgSlHK£(l)4W“£ 
IA«lil’’. Mftw y MlE^^ilTfg^(2)^‘ , ^MWX§^W^”o Tj 

t mw&® a , 

fflTafcfcW 

netjC.t') =Zl"=itw«x,(f) (3-3), 

ne/'(t)frIT#g%i n«*i “T, > 

.011^ O,(?+l)-^x,(/)^|0]^^^M^^ffWtt^7C 

^fffimw,®£wx^#,xtjat^HSj6(4)4W“*ttiiiii w »w*^iHnn*^ 
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$ 3 ^/AlttSPcm 


6)4»ttS5cW“W$ w . 

ss:(3-3)aor^ 

»»AIpI*X W/SfR 

net jit) =vjJX (3-4) 

g+.w, fnx 

W, = iWy,W 2 j, — ,W„j) T 
X — ixi ,X 2 ,’",X„) 

Xo= -l,u>Q =T > ,P!!J ^ ~T, =X()Was » A-^if^fil^li nj 

net, — Tj =netj = 2"=i =WjX (3-5) 

a&.5t(3-4m'j[p]f w, ffix i 

(3-5)*Hinu?H&. 

Oj =netj =finetj) —fiWjX) (3-6) 

3. *MgxM$tft8» 

T4«„ 

n,x>o 

fit) H (3-7) 

[0}X<0 

BP^ net/^T, l,%net/<Tj B},#^7G*W 
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JIOIXt'EXiYLAM.IJIYINOVONG 




a 3-6 

mmwgLTtmmo sigmoid mgu&m,® 

/W-1^=7 «-8) 




/<x) = 


1 +* 


-1 


1 ~e 
1 +e” 


3 - 7 0 




(a) (b) 2XfSttSM$ftS«t 

S 3-7 S 

«g#W»/S*ttg%WiA^i;h#-£Kfg]ft$. *7- 
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% 3 





(a) (b) 3R«tt^Stt$-lft(Bft 

a 3-8 

(4)«E4*St$&®» 

P(1)= TT ^ 7T (3-10) 

3 . 4.2 

Ax#gw»ntsiiiiJttAJBW*2|t47c-— nm m 

Mm, iSfcfP^^iKS'J^WAlii. 
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■■1 IIOIXUEXIVI'AMJJIYINGYOMj 

muB.s.£i$vi&jniMYkmm2io mitt&mm-femi ^#g%isjs# 

##*1* ai^sax , #tnr a#jw*b iwi i m ® , *qM ± 

±^|W|^0 

l. 

(1 

3-9 ft*. mAm&W&TC&i 

g w» Afss, ## ^ 1 * ra# mmn&jt »£ w & r&m 

efcfiAtta. a&ft m fa ## < intwftnw^fi^a& )$ti ftfiAtta^A. m 


® 3-9 
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W, 3 ^/AX#4§E& 


ft® 3-9 

m A ft ft ft SiJT-M .Mrttt&TcA# ^ftftii j£M o 



mmat^mm a , tn« m ummm . 


a 3-10 



a 3-n 
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■■I JIOIXUEXJVlMNLUiyiNGVONO 

(2)2iigy^ 

3 mu. 

CD£MS! 

3-12 m tts, 

WSfr+W^UrAK-^^ifiWM^rSft.Anffl 3-13Bfrw. 




a 3-13 JSj^S-^m 

2. RliM^S 

ammmm 


• no • 


$ 3 M/K XttSPUft 


tfaiJiurA. Kfttira»+«-MW»aj*T-Ji6«ittA.<&j6ttAfcaiWfaJi 

mat w m tm , m ji-mwm m m m % < m am *p$& Hi m ) .ms ti @j a# 

(2)£«a!W& i 

3-10 

3-14 0r;SM^£M*faffi£jK. 

Ste3Mhffl 3-9 Mil 3-13 + 

JHJcai,4lA*itfs^s«ttKrtiiM?*:a,«r*srts^ai,s«^5:aa»&« 

Maa&si. 

fir Atta ,i@saffi&&, saymtt *n&#rpiMtt. 



• in 


■■ JIQtXUtXtYUANUJIYINCYOMG 

El«:x-y 200 

VJ. 4 + ’ ftf/jOa >2 ‘O’ 3-15 



s 3-i6 


pj0%WLTm>¥& matlab su^. 

clear Xo xi x 2 ; 




$ 3 


beta=0. 1; 
miu=0; 

[n m] = size(x); 
for i=l s 1 - n 
Xo(l ,i) = l; 

Xj (l,i) = x(i,l); 
x 2 (l.i) = x(i,2); 
y 0 (l ,i) = l; 
t(l ,i)=x(i,3) j 
end 

a 0 j =rand(); 
an =rand(); 
a 2 i — rand(); 
ao 2 =rand(); 
a 12 = rand(); 
a 22 = rand(); 
bo=rand(); 
bi =rand(); 
b 2 = rand(); 
delta_a 0 i =0; 
delta_a n =0; 
delta_a 2 i =0? 
delta_a 02 =0; 
delta_ai 2 =0; 
delta_a 22 =0; 
delta_bo=0; 
delta_bi =0; 
delta_b 2 =0; 

1 = 1 ; 
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■■ J1QIXUEXI YIMNUJIVINGYONG 

while 1 

Ui=aoi * Xo+a u * Xi+a 2 i * x 2 ; 
u 2 =ao2 * Xo+ai2 * xi+a 22 * x 2 ; 
yi=2. /(l + exp( —Ui)) —1; 
y 2 =2. /(l+exp( —u 2 )) —1; 
v=b 0 * yo+b, * yi+b 2 * y 2 ; 
z=2. /(l+exp(—v)) —1; 
error=0; 
for i=1; 1: n 

if(z(l,i) > 0 &.&. t(l,i)==l) | | (z(l,i) < 0 &.&. t(l,i)==—1) 

% 

else error= error +15 

end 

end 

error 

tempo = — (t—z). * exp( —v)./(I+exp( — v)). ~2; 
tempi=bi. * exp( —Ui)./O+exp( —Ui)).‘2j 
temp2 = b 2 . * exp( —u 2 )./(I+exp( —u 2 )). "2; 

delta_b 0 =miu * delta_b 0 + (l — miu) * beta * stim( — temp 0 . * yo); 
delta_b 1 =miu * deltabj + (1 — miu) * beta * sum( — temp 0 . * yi); 
delta^^rniu * delta_b 2 + (l — miu) * beta * sum(~temp 0 . * y2); 
delta_a 0 i = miu * delta_a 0 i + (1 — miu) * beta * sum( —temp 0 . * 
tempi ■ * xo); 

delta_an = miu * delta_an + (1 — miu) * beta * sum ( — tempo. * 
temp!. * X!); 

delta_a 2 i = miu * delta_a 2 i + (1 — miu) * beta * sum ( — tempo. * 
tempi • * x 2 ) ; 

delta_ao2 = miu * delta_ao2 + (1 _ miu) * beta * sum( —temp 0 . * 
temp 2 . * xo); 
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$ 3 


delta_a 12 = miu * delta_ai 2 + (1 ~ miu) * beta * sum( —temp 0 . * 
temp 2 . * xi); 

delta_a 22 = miu * delta_a 22 + (1 — miu) * beta * sum( — temp 0 . * 
temp 2 . * x 2 ); 

b 0 = bo+delta_bo; 
bi =bi +delta_bi; 
b 2 = b 2 +delta_b 2 ; 
aoi = aoi + delta_aoi; 
an = au +delta_an; 
a 2 i =a 2 i +delta_a 2 i; 

i 

ao 2 = ao 2 +delta_ao 2 ; 

3i 2 = aj 2 “bdelta_ai 2 ; 
a 22 = a 22 + delta_a 22 ; 

1=1+1; 

if 1= = 1000 

break; 

end 

end 

ji = l; 

J 2 = 1; 
ki=l; 

k 2 = 1; 

for i=l;l : n 
if x(i,3) = = — 1 
if z(l ,i) <0 
x n (ji , : ) = x(i, : ) ; 
ji=ji+l; 
else 

Xi 2 (j 2 ,:)=x(i,:); 
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j 2 =j 2 + l; 

end 

else 

if z(l,i) > 0 

X 2I (kj , : ) = x(i, : ) ; 

kl=kl+l; 

else 

X 22 (k 2 , :) = x(i, : ) ; 

k 2 = k 2 +l; 
end 
end 
end 

hold on; 

plot(xn (; ».l).xn ( : .2) /g * '); 
plot(xi 2 ( : , 1) ,X ]2 ( : ,2) . 'r+') ; 
plot(x 2 i ( : ,1) ,X 2 1 ( : ,2) ,'bo'); 
plot( X 22 ( : , 1 ) , X 22 C : , 2) ,' r+ ') ; 
hold off; 
axis([0 1 0 1]); 

200 

“X” 3-16 
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3.5 

-lEinratt 

'Wfi^ltD. O. Hebb m J. Konorski 

ttmt* m-W‘L'm7m(mziL5JgM)^mTmzMmmMM%xh, £ 
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{ifego 

w&m 

tti &#ae#£ m tm mMtt m *, h nt >) w ®f 

iKMft ‘*M ft 5HU ilTHr ^ M M$£ $: *. 

&&&%&*%%$}mmmL 

& ,ft% u frmm*ir”. a^Ttt«, s- 

mMnM,. . *«u Aft 
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MXo 

mm^%&%mm*&mmmimmmm?,vj>fs %%&*} Zc&m? 

W«uAfg,tH^3J^M[5]t^3|E 0 + 

aw. 

bus. 



a 3-17 famsi&ffi—foftvi 

Amari T 1990 

3t/^n® 3-17 ft*, tj 

IfiJfiW,. T y =K;o;,MW!ilA^»Xo tl* 

-1. »X W*»,iffi 


• 119 • 




■H IIOIXtlFXiyi'ANL.mYINC.VONr, 

w, w*/ RtSIttltifift / 0HJ(iJMMAfr*X(/)fq^{=-i| r MiH 

MiEtbo 

AW ; = rf[_W ,U) ,Xit) ,d,(t)^X(.t) (3-11) 

T— 

W, (f+1) =W, (/) -f ^[W, (O ,X(r) .4 (/)]X(f) (3-12) 

3.5.1 Hebb 

1949 D.O. Hebb 

ftJH”W1S«» Hi, ^tfgxW^ME&t* 

i ^matj r^j0>m a a « £ oa m # 2 .iv.jm^®*&$ 
®. Hebb ^ mm. 



r=f(WTjX) 

(3-13) 

um 




AW j =r/f(WT J X)X , 

(3-14a) 

I 

tzifiii 




Awj, =rjf(,WT ,X)x, =rpjjc u =0,l* — ,n 

(3-14b) 


^WlXl^MW*A6^D|S]o ft&#til«T,H e bb^a»!l*Si^«a® 

Jtfc^h (t =o). w, (0) W 

/WStM. 

Hebb^^MPl'Ht^-#«m>^^'JrP^>Io ««W$4Hfrfc£##£ 
* ra$8SS!+£*KfftB. 

Hebb ¥%mm$Lmo 
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3 . i im 4 r=o,^g$ 7 =i, 3'Mi 

X, =(1, -2,1. 5,0)T,X 2 =(1, -o. 5, -2, 
—1. 5)T,X 3 =(0,1, —1,1. 5)T,W(0) =(1, —1,0,0. 5)T 0 

/(«eO = sgHGze/),&{IM^ 

(1) »A*-- > N** x, ,if»!f$|A n«*i JHl«|p|fV(l) : 

nef, =W(0)TX, =(1,-1,0,0. 5X1,-2,1. 5,0')T=3 
W(l)=W( 0 )+ 7 Sgn(M<?d)Xi =(1, - 1 , 0 , 0 . 5)T + ( 1 , -2,1. 5,0)T = 
(2,-3,1.5,0.5 )T 

(2) «r A3Sr>M¥* x 2 A nrt, w( 2 ) : 

i 

neti =W(1)TX 2 =( 2 , -3,1. 5,0. 5)(1, - 0 . 5, - 2 , -1. 5)T=~0. 25 
W , (2)=W(1) + 7 sgw(ne/ 2 )X 2 =(2, -3,1. 5,0. 5)T-(1, - 0 . 5, -2, 
— 1. 5)T = (1,—2. 5,3. 5,2)T 

(3) ilAmH^#^ X 3 ,itlPfM#A net, .tflHBEfclRl* W(3): 
net 3 =W(2)TX 3 =(1, —2. 5,3. 5,2X0,1, —1,1. 5)T= —3 

W(3) =W(2) + rjsgn(net 3 )X 3 =(1, —2. 5,3. 5,2)T-( 0,1 , -1 , 1 . 5)T = 
(1,-3. 5,4. 5,0. 5)T 

BTil5L,33SftBB»*^§S»B.7=l 

/(«*) =a- e -net) a 1 +* -««<>, $ 

(1) wrt, =W(0)TXi =3 

Oi =f(net \) =(1 ~e — net)/(.l +e~net ) =0. 905 

W(l) =W( 0 ) +t}f(net x )Xi =(1. 905, -2. 81,1. 357,0. 5)T 

(2) neh =W(1)TX 2 = - 0 . 154 

o 2 = finetz ) =(1 —e—net )/(1 +e—we£) = —0. 077 

W(2) =W(1) +rjf(net 2 )X 2 =(1. 828, -2. 772,1. 512,0. 616)T 

(3) net 3 =W(2)TX 3 = -3. 36 

03 =f(net 3 ) =(1 — e~net )/(1 +e —net) = —0. 932 
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W(3) =W( 2) +Tjf(net3)X 3 =(1. 828, -3. 70,2. 44, -0. 785)T 

3.5.2 ^rset^.^n-is.'^’^misu 

1958 FrankRosenblatt tl iA/E[J><CT— 

,»*]**!#(Perceptron). M 

^7# £57G$iilMii fil (fWfg - ^)-^^ P^$bu tH ~ZM. 

r—d, —Oj (3-15) 

&*,d, , 0j =f(WT,x). 

riw ; r $^o 

f(Wj$X) ={\mathop{\rmsgn}}(Wj$X)—{ (3-16) 

l-iwjs <o 

AW> “^[d, -sgw(W[X)]X (3-17a) 

iff,; =^;-{5g«(W7$X)]x,*-=0,l,-,n (3-17b) 

7 4 ffl5g«(WT J X)G{-l,l},tZ{tTO^PT®^ 

iW ; = ±2rjX ’ (3-17c) i 

m\ RM7 - mm w&a , ^imm. 

3.5.3 

1986 McClelland III Rumelbart A 

r=[d ; - ~/(W > TX)]/ / (W,TX) —(dj ~Oj) f {.net,') (3-18) 

£+./(w/rx)^ftg*fc/(«*,>&# 
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3EifciiifS(»#Q Sigmoid iD$L 

. i^±^iiJWiiiii^»iiiWi/hWM^i#iii*. 
fexn&jm tJB ^mmm &zm 

E — \!2(d, —Oj)2=l/2[_dj -/(W,TX)]2 (3-19) 

jEtk.EP 

AWj = -t J &E (3-20) 

5C+,«:<«*«:7*->ME#». 

A E--td i -o,)f(.W i TX')X (3-21) 

%jfc^ftAS:(3-20),Br^iR(i«WlliHf^ 

A Wj =rj(dj—Oj)f'(.net,)X (3-22a) 

nTW#dJ,±5S;+ 7^X^fBl^^iEJi^(3-18)4 1 2 ^J5CM^^fi-§-^ 

AW,' 

Aw,, — rj(d, — Oj)f' (net j)xj =0,1 , — ,w (3-22b) 

0S 3.2 S# 3 Wo = 

U = -1,^$ ? =0. i.3^|fcAfa*ft&#&fa*^d*Xi-<-i,l, - 
2,0)T,X,=<-1,0,1. 5,-0.5)T,X, =(-1,1,0. 5, - l)T.W(O) =(0. 5,1, 
—1,0)T 

f(net> = (l-e~net)/(l+e -net) ,U 

(1) ^iAff A X, ,rM£?^$mA neti JUXInJil W(l) 
neh =W(0')TX 1 =2. 5 

Oi =f(net \) =(1 —e—net )/(1 +e~«?£) =0. 848 
/(ntf,) =1/2(1 -(o,)2)=0. 14 

W(l)=W(0)+ ? (d, ~o) f'(net\ )X| =(0. 526,0. 974, -0. 948,0)T 

(2) $iA#A X 2 ,if»^«iA fitZlJq# W(2) 
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net 2 =W(l)TX 2 =-l. 948 

02 =f(net 2 ) = (1 ~e~net)/(l +e~net) = —0. 75 

f(neh) =1/2(1 -(o 2 )2) =0. 218 

W(2) = W(1) + 7 (<7 2 ~o 2 )f (net 2 )X 2 = (0. 531,0. 974, -0. 956,0. 002, 
0. 531 )T 

(3)$& X 3 A nrt 3 Mfri; W(3) 

neh =W(2)TX 3 = -2.416 
o 3 =y() =(1 —e~net)/{ 1 +«; — we?) = — 0. 842 
f(net 3 ) =1/2(1 ~(o 3 )2)=0. 145 

W(3) =W(2) + 7 (c7 3 ~o 3 )/(net 3 )X 3 =(0. 505,0. 947, -0. 929,0. 016)T 

3 . 5.4 

1962 ^.Bernard Widrow fP Marcian Hoff JitBT Widrow P|j Hoff ^>1 

mm. 

r=d, ~W,TX (3-23) 

AWj =rfdj ~W J TX)X (3-24a) 

AWj 

Awij—r/(dj—WjTX)xj i — 0,1,(3—24 b) 
^ /( W,TX ) =W,TX, 

MG 

f (W,TX) =1 

jiMj£(3-18)^(3-23)ffl|fih H lit , LMS ^ 

. 3 . 5.5 
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r=dj (3-25) . 

H## AW, R 

^Wj^TjdjX (3-26a) 

Awij = Tjd.,Xi i=0,l, — ,n (3-26b) 

|Rc(,x, flSclHtbo 

^MPl'JnTW Hebba«IJtt-#«p3»i»a. &l!ftt*M*,Hebb*g»JldJi 

i<j#o 

3.5.6 mu 

(Winner-Take-All)^MMM, ffl^W 

W„,TX =i—m\ ,2a,x'!,p(W,„TX) (3-27) 

Aff,=a(X-W,„) (3-28) 

w m m-&&T&nsimAx. x ffi*«»A«5$&t,±ifc 

$Mk W#fi7c3E«S«Ett. 
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3.5.7 

3-l8 0 IS 3-l8(a)4 , WP t 3Mtr*^M^g^iktt^7nWiuAj]PlXfg-^,H 

iit M f §% W £ * £. M fk M lx tt ft ft ft * rt a tx [Sj ft ; is 3- i 8 c b) * M *h aH> 

Hi m Hi An Uin %, 0lit a f§^ M£ftj6 , MMft ftft 
ftftoWhafcftft. X ffl 

sa^fr-t w, w£&. '&&JRMT x 5 w, wffiraeft.&«ft«5$ 

(3-28)i^S„ Silt Winner-Take-All ^^aWlJ-^rtaMPJ-SCo Tffi^^f- 



(a)rtMIJjS (b)tt£=P& 

@3-18 ft Z *' 

faft^lTO&Wfl'aKfiftffi w } 

A W^rjCd-Wj) (3-29) 

WSt)£-^f^ffl^l^(3=2»>4*W a lEftj£(3-28)£HiMrta^>f 
aiiffii! fjS> 5tf®wrtatti6i*ifi]»Aisi*x «-#,s:(3-29)^HiW^a 
^»lTFr,6> Xif®W^a#flftfafflSftftfl*d ftft. 

m±«+^T#g , iswi^ iiBi^r# s * 

3-1 
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* 3-1 ij-m 


# g «J'J 


Ti'fjLW 

#>} 

7] X. 


&itX, 


Hebbian 

AW, = rjf 

(WjX)X 

AW„ = rjf 

(WjX)X, 

0 

iL%-n 

i±& 

%-m 

Perceptron 

AW, = v ldj - 
sgn(Wj )X]X 

AW, = rj \_dj ~ 
sgrKWjX )]x, 



-&*] 

S5M] 

AWj = v ( dj - 

Oj )f(petj )X 

AW, = rj (dj — 

Oj)/(netj )xj 

&& 

-%%-n 


H'J'^ 

at LMS 

AW, = r)( dj - 

WJX)X 

AW,, =Tj(d, ~ 

WjX)x, 



&■& 

4s 

Correlation 

AW, = rjd,X 

AW,, =rjd,x, 

0 


&& 

Winner-Take - All 

AW, * =rj(X~ 

W, * ) 

\ 3 
w * 

II 

<3 

'"N 

H 

1 

RS.^, 

fa— 'It 



Outstar 

AW, = t) (d - 

W,) 

AW*, = T)(d k ~ 

W*,) 

0 


am 


3.6 

DtftJF^-^iiff^A^ilfJniWM^. 
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3.6.1 

-'Hm&ummmmzmmmmm*m w %if&mm 

1. mmtmmmum 

bp mm^m 

As&ra®, 

rn, ft Ur j&ffcfctMTftM S ft im m & MU AU> ,6. x*q, 

^^W + W'jFWitia. 

2 . #gw»w«Ttiie-^is^#f 

#SW»W«Th?FSil8nrKffllH 3-l9J9f*W*SEjfeffl*»i6. i5i+i3 

3 33!sW3fe,Ji^^^tff ;»*>:.Jiftlg®#,-&«• 


• 128 • 



$ 3 #/A 



a 3-19 a$<&■&&&a 

(l) *&«*&«». 

M®,Mi*) 

toffl3-20!»S>h*^MJ^-ttAhaiieW2l*a-^5F«lBI«ltS:ig 
me.Ba 3-21 

ists»«tfnft*^ffi. ® 3-21 ^wis>hiag»iB«pfRefcraj«M^aiwffl*, 
MIS. SDt^tt»**SEaafn*SEtlrJ£W^*x*.'eiiEi»T^«rft^#f 
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tnaM£5Ujggajsffl 
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S 3-20 4t4»&3 





(4) 

i&ty „ 

3 . immmmmvt 

. &s£*au3t*r* m w m tm^mm m «r tbtt. 
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w. 3 


(1) W4MfcIEflf&4S 

^•tbo u £*s#g 

»t,6 fittg|4S4+p 2 60 % . 

m&m tiM-mfrmm . -un« &mw ** s mn& ra % 

JF£If£iE&®f 3S W if «;£-. illl ft881 a» M W*R A -^ ft ft % 

my. mm w ijh m m imn ##*« 

*8S:BWH4fc2:—. 

(2) 

E=|2jL 1 E^ 1 (Jf-of) 2 (3-30) 

M&l*Q##jrftili|«#£raafrM SMIfTOlM. 
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b %isjiT&&fcx %$ mmm mm ts ** w#« w *&ma tr.& & . * 

bp mmmtim . 

(3) j0-ft«^ 

Pinda||{tiT-*#-^»fiW#«ftt*^,JRII* 0-1 Mjggftlg E^no 
E««=yEjl,2{-iWJ-2 / )* (3-31) 

anr/few»a»aut.p we—fc«M e» jg 

Jt^S(3-30)tt^.«H E iW±SWE man 

En=E/E msi „ (3-32) 

n-vc&mt BP#gw«H-^w^. ^ b $•• it«”in m m it h, m 

JM t *&0#flt^.dia“*|FWfll«”JiE«=l. S#^:g#jfcjg,E n Wdug 

But, 

ij3-{kmmmM bp mzw&rpmfiftmiMmmz-' 

(4) m&mw&Mtst 

» roc m 

ffl*Kift*ifcX- > N* Hi U tb ■ftIE«H4, BitfcTffi WtittfclS 

+ ; FIM&{iJiyj6W&. 2d® t ft 

4 #nT«,?<JT3l 

*3-2 *. ^-^oI|gtt^^*ra't4#iJ®f(TP),BP^^WWtt#iJ«r^M^«f# 

sy ft m ffl-a, tb %m&m Hi n&ft E£*m »iii& 5 % - # *r 
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t m & % wl ro m\ ®r ( fp> , bp % mm i ro &n m & n m,mn % 

mmmmmmtw vmmm, 

31 3-2 RQC 




FB'fi 1 

JH± 


FB'Ii 

TP 

FP 

I5H£ 

FN 

TN 


7pjffl±^4 roc a#. m-mm&T?/ 
<FP+TN),i85*®PHtt45. roc itti tfe i+i * m ^ a in fg m & & $ii] ± M * m m 

roc m 3-22 roc 

Eft^ NNT2 ftUMMtfc NNT1 0rffc£M£gEStti5fT tttBMJf. ^ 



® 3-22 rcx: 
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roc imrvtmm 
roc sbbm 

®#ut~ > MMfc3rf&, roc ft &, wt ft ®irm ra w-'Hp# , ft m vx r ft m 

w ft * vx t ft SIR. -# «# ft i+»#& 
^a^*ffl«ftjfic,#tMi»^#f^wTW®«. #*a«ft»ft roc ft^, 
*f?F*5 9~10^. 

^*aes**is#*ft^***«EaiPJWnr*tt,ifeisc3#®tz*,*jej«. 
^ roc ft^^+wjtwtt^*pi. 

ft»J*_**#£ff*ft]Efllft 

3-2 *.,« TP/ 

(TP+FP),£fe^**rott^tfft3Sft s 

TN/(FP+TN),gE»***tt^. pTW# 
tti,MttJS,l#J*fP##JSJi^3-2 * 4 #Mft£-#3tj*^ 0 
4.fe1A«ft®£J:3l 

(ft s$*t bp raft^A 

&m-ikMKG W*Mff». -*##JSLft1#«Ji,*A BP Efc-'NftAtf 
^wjRj&»s***ft.«ftit t m i'h]^ ftffx#. f^jft. ihmvm 
fts$*fff#u-£tsft*ffi®iiiAra§. 

ftmM^^*Att(X nax )^/h{i(X n , n ) 

^lPU)»! 0iJt5feMWft{tft±-x™,o fncx^ -x mm )^|H-].& 
x^-x^. &#^wftfiM-Mo~i zmm, 
x^fti % 
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wp-smii 

. ^^^^Jt^fnRtm-o. i~+o. l $fls. 

o. i o. ooi o .\%m 

iinT® 0~1 E(^filBfe^5(F5SM«Ba.ttjSJiff*W > h3Sit^:ISI.W^*<ai« 

sti«. 

3.6.2 

icssswfi&R&e 

(i)W»W3»A—na. 

£i£ 10 Mrnim 4 
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fori i=0;i ^nlnputNode;»'+ + ) 

Cigf^taw N>Mc*«0~N-l ihMM^ 

tt^TC, ±3£IJt A /IiHM'N£&M M£.«fit# fit ft M M 

±0.3)4x^^{t^^nTw*-^i?imtS(? fc !!fe^^ o mi mmMJS'iizmjs® 
m weifi imn Aft m *^. m * x #*q* a#* *m ft. it t it * * 
ft, i n bp 

mis 

mmm. 

gfrae+afrft*. 

lift w i «, m ^tM tm ,mta 
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, il#. Rl dtfr 3fcM“& 

^^#^TjSfe8tJi*ttgM«fJsfi 1 ^5KJ&#3fcffti(lifi^. 

3.6.3 

atirttsra»w?F^feWiaT 3 nmg.. 

(DAISS. 

tt&ra 

^WM+llIRT-^WW^.^SJKiftWiKFragmenOKJiaSW* 

3)£ritra&«si. 
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(1) m*mt\-m 

solvelin 

solver 

solverbe 

solvehophopfield !*<]£& 

(2) $&g»3§ 

hardlim fijEPillpIff illiiS: 
hardlims X>t #|’ fi£ PH AS f if iH Hi W 
purelin ilHiffc 

tansig JEW s glHifilRS^ 
logsig s M'ffiMHitfc 

satlin §fc 

satlins 
radbas 

dist i+jr-ffiJSBMlESf 

compet 

dpurelin 

dtansig IE#I 5 

dlogsig Xtlfc .v Syf^iH 

(3 )^^mm 

learnp 

learnpn 

learnbp bp^^MPJ 
learnbpm tffzfaitM#] bp ^-9M5l!l 
learnlm levenberg—marquardt 
leamwh widrow— hoff 
- learnk kohonen 

learncon conscience iSjflC^^I HiUBt 
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learnsom ft ^3 @ ifc 

learnh hebb^^MPl!j 

leamhd hebb 

learnis 8WJ 

learnos 

initp ^Si&liclJJirfffc 

initff nrfarasfrfcji&'ffc 

initlin Us'ttJUlUin'f'fc 
initsm 

lmtelm elman j||!J3l®l^W : ^Il!f)'f-k 
lnitlay 

mltwb Wffi-^ttfSWloifrffcS# 
lmtzero 

lnltnw nguyen-widrow MM 
lmtcon conscience @j{l[$J'&J#R'ffciSi$[ 
nudpoint 

nwlog 5 nguyen-widrow |5®#l£S( 

nwtan IE (33 5 S2i@$ScM^ l r?>;’ ac *ti nguyen-widrow Rt#L$[ 

randnc —ifc?!l KEtfl^SC 

randnr 

rands 

(5) d«»£ 

deltalin X*f purelin ftlSycM d 
deltatan ansitg ftIS teM d 

deltalog logsig ftg>7CfM d 

getdelta A^SafifM d 

(6) M$fcA«» 

netsum F*]£fr$i A® 
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dnetsum l^-^L 

mae 

mse 

msereg ±^^T#w/regfti^^fr®|S( 
dmse 

msereg ttjJjM. w/reg 

(8) ^M^ 

trainwb 

traingd $JfTM bp 

traingdm $5JirFP$ bp |i( 

traingda #jKTP$ w/gM lr 6<J bp %mmM 
taingdx $lf§£T\% giiJS lr fft bp ^&ill|^®tS[ 

trainlm levenberg—marguardt bp JlfeiJIl^ilitSf 

trainwbl 
trainc 

trainfm ijl|t$#'|4ll] 
trainlvq ill| t%. lvq 

~nbpx f lj fflMS ft f^tfiJll *! W % 

trainelm ijl|£& elman jJilJdF*]^ 

trainsm 

trainp 

trainpn 

trainbp bp ^&ill|£$mlfn]l*<l£& 

trainbpx jfH&jit bp ft W\t& 

trainelm \}\\t% elman i||!l3P«]l& 
trainlm levenberg—marquardt 

trainwh if] widrow—hoff MPJlJiJll 

(9) ft#fm 
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errsurf 

maxlinlr \\% widrow PH hoff 
presflop 

(io)#p«aagii 

nbdist 

nbpid 

nbman {$>manhattan 
neighb Id—£#.§Pis£lSi:l$[ 
neighb 2d“*®«®$[ 

ind2vec 

vec2ind * 

(12)j£^ 

normc rMflS— 

normr 

pnormc 

sumsqr rUf 

quant 

delaysig 

combvec tfifcistM 

plotpv i/o fill Hu A ft it @3 

plotpc 

plotes 

plotep 

plotsom 

barer ft iiftilijill^fl^lll^ 

hintonw 

hintonwb 
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Jlt}IXUEXIYL ANUJIY|V(iYO‘i<- 

ploterr 
plot fa 
plotlr 

plotmap gd J*^fffS4PifiattW4$tt 

plottr 

plotv 

plotvec 

plotsm ££?&] S £§£R@&lj'[?l 

(14) M^ 
slmuc 

slmuelm elman jUB WltfaifiM 
simuff 

simuhop hopfield ffltfaifjM 

simulin 

slump 

simurb 

slmusm ^ ^JL^RH 'kMffiM 

(15) |#)£&'&JiiiSi$t 

newp 

newlind T^rf*— 

newlin y i''^'|4M 

newff frjit—'hmtfi bp 

newcf ftjit—bp W\i$ 

newfftd ''f" HU Unfit Al®i5 bp 

newrb —-'t'S ftlEPlIift 

nwerbe i5i+— \t& 

newgmn T&i+— 

newpnn T§LtY— 

newc $Jll|— 
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newsom ■'t' S 

newhop ^ hopfield j||IJ3|*<I^ 

newelm —'t' elman jJt!i3l*P& 

sim 'MtSWIfc 

init tti&fti— 

adapt 

train ill|&—'NfgWifr 

gridtop 

hextop 

randtop 

C18) gigJ5S®tSt 

adaptwb 

adaptwh widrow-hoff MLOI'J § iiJSi/»] T^'ft/llfrWX 

(l9);Ri|» 

dotprod IXiSIfcM^MiR 

ddotprod 

dist euclideani 

normprod 

negdist negative I®f£p|X Hi 
mandist manhanttan $pjS)$L$\WL 
linkdist link 

3- rn 

(l)Plexi#ffl*6ff£JFi£ 

Plexi £->h rt s Lisp ^Aih* 
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■H JI Ql X U E X1Y U A N LIJIYIN fi Y ON G 

!£*§$!» Hinton 

TO M{£M 

{to ««Mfi-s^?t#gw^«ai,<aifeRrwiffS^#gw«i«ai. k 

LkpM.DtttatfffMttSWSfr. 

(2) Neuroshell 
Neuroshell 

Neuro-Shell ^Wtt£^«£«i5fr#IS2tfT&ffl 

» M7K,ffl W SIM . 

(3) Neuralworks Professional I] 

Neuralworks Professional 

ascii xnmmpufim^to c 

Hinton @^ 0 

(4) NETSET n #&W&7F£JF£ 1 

mm&i&ft=F / i'Aifmm windows 

netset n 

(5) N-NET210 tt£H*fr?F£Jfl# 

N-NET210 ff 
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% 3 

macm 

(6)CaseNet 

caseNet m-wtimT^Ai+mmmzm?f%:ffi%' ww&mmk 
imimMimmu mm. mmm^Aimu±^mm 

tko CaseNet 

»&,*CaseNet 

W‘&£f&Mifcikmmm,,vMm±^&m\mfi^A\imm7m< 

CaseNet *SE* W# 4 

mm^m'M-mmM'ik^x s. Mr«ffl&ra$«££#}*£tteia. 
*s#WfW&M jb ftn$n%£i$ £ bumt wttgra$. £*$gra& £ 
#i±@ +. Wffl+filtt&tft (fcfls M 

Gfrgwfc#. 

3.6.4 

l.*E& 

#gw«»wgft^ajittgras£-. R*t#g i*j*&$ 

Kiraa. 

gggis. 

ttgW^Si^iW^gWttgro^^SSII.^ttgTcRgXiMftAffifAafi 1 
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■■i JiniMJkXl Vt.ANl.UI VINGYONG 

»£*Msra$ Mmmmmm' x, «^r#nttt-w#i+w cpix 

iRftt#MiBfc N S^TR. Maoris 

W5fe»#gxWje*a«iiia*i!KVLsi)*3iEs*«iittrt#. &xax 

m vlsi 

vlsi 

VLSI £». £<£X&)f XM^XW 

xmbiufib.MBh VLSI 

ttm&w&mmstmmifcH . 

aafe^nr3t«« 

(2)ai?tta 

mm vlsi xxfq^AW^M, s strew 4#ts)t±iiJLo 
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% 3 

vlsi, 

mWMhtmw VLSIifX^IE*^:M^.fiJfflIi>i-«^S7tc^H^ VLSI 

mmtm vlsi 3 ^,bp^ vlsi £$uim vl¬ 
si vlsi m 0 

VLSI 

tm , w±* w i s&stmtflix*, M-TLjir 

fe&fl;MM®#-,,.i.M^2f®: *1lU£3ffitt*M««;xt» 

( 

VLSI 

HMiF-§-Wiaif#l»J*«f. 
mm visi 

mfc Jt mR ' J ? , H IfffJI® MR MM® i ii3£3l®'&, .BJSttHi# Jt lii 

&&. n wit;«® , smsas * * 

STBirmW»#&*§M VLSI X2,nHfF»^*J»fDeiKl*»iUaftB 

wife a ,&, gs# rt m . »&»/«&, 
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■■■■ 1IQIX U EX IV U A N U1JIVIN G V ON 0 

vlsi 3 

<&+KW«isr#w 

vlsi 

ini? i£$l 

DRAM,SRAM, 

eprom,rc)M 0 
$rfT ^7 JXr$I^Fo 
VLSI 

ftMMMsSt MOSM&^XMOSJf^ff^&WM.ff^M^k 

£^se > . -fm , 

ia mos iH&iilT nlffl ^ 

d/a 

lll£ife^lttl$Lfc£SL l^{S4h31bIfflSX^^Wfimtk^t§$SEo S« 
lo WI-telIilMtfifWfIiIJ}£(|[i:fl§«llgii, 
m-Y ^ s m m * &. i# tb ^ *x ft ijM m ft 5ft fk w * ffi ■£ tfe «£ ft. ft- % m & & n 

WJSfHS. 8UK VLSI + 

a*,i§s^eraMM vlsi 
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% 3 #/Al#£E& 

jas.ist*, 

(.3)‘£MmM 

m 20 mzjsmmmmiBmmxmft', 

l». 

2. #&7C#ft 

W££3^*#3«MWfeifr. VLSI 

Mffi7^» ttaw^w vlsi £«±M»8^£SL»^&«,#*ts 
(l)«E#l^#g7C## 

U&0A§P^Mo 

0Ji-7-^«u A#fe1 * M M<£ A; 
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(h) SMilf^TC 
@3-22 *£-*£#*£ #J 

itmis 

Hopfield W^W«lfilttiS7Cit*jS#5fe«W. HI 3-23 

(a)^—tSS«l#g7cWSi«I.ffl 3-23(b)*#f^«|«l#g7C5:affliaW#g 
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$ 3 g/AJLWzm® 


ram . 

I&4## MNOStt*)3t£0[3Eft{l. 

vlsisk-±o vlsiem 

&j£ VLSI Wit 

VLSI sfrKM#&7D»fl=. VLSI 

SI 3-24 0fw 

*&**«**»,»* 3 ap^fiia.ttg 

tts. aflm*#g7cw$& , mzTGW^f&r 

mmm-. 


y—F (LwjXj) 
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M| 1101-XIIEXfVI AM,IIIVlNCVOV(, 

rtmn&Tt&mmmmim 3-25 mm. x,= 



® 3-25 

isa^tu 

( 3 )FPGA tt&TG&ft 

fpga w«f».'ewiaiSxx-^-ii» vlsicmos 

fpga 

MM;5IW.«i4a. FPGAftJSIk^ttgM 

«yMr&#w«r&. -#ffl fpga gmm&Tttgmm 3-26 0^. Pit 

FPGA$tf|WfcjKW£* t JfcJB FPGA foftm&X%mftgL7t%V3M ! mM£ 
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$ 3 



SdT-JgWHiti 

S 3-26 — FPGA #«>£.&# 


3. 

vlsi 

&. «&2f5£*f n'M&7&&&&*&&&£., 

&HS&+3T n 0(« 2 ). EfcT4» > NtS#7G4 I MiIJr 
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■■1 JIQl X UEM Y l' AN LI JIY INGYON'G 

cache 

(2)Systolic 

systoUc^jgf^aiS'&^frttawjStfflica. gix^ vimm& 

iSffl Systolic ffiSlto IS 3-27 Ji-fl^lt Systolic 

IS 3-27 «t»WAh3#7n(* 

MiSttDifeisaff minim:, * (si ^. %jb w fta * m m w 

Systolic 



3 3-27 — $ Systolic jj+fc&tf 

I®* VLSI X^Wia^,^^M^^f®^ 5 Systolic • 

(3)Wjftz|c^*SE^ 

m- VLSI MHritffi®iti!l 21 lOOf&fe&.BP# 
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$ 3 

-±MgRffiMm*j 5000&?&#&&&%!'#& 
mmwL^ vlsi s^+wiiiaa#*w#je».--#ji#±i6WAhaj^7c# 

, aft$«wttg7c» h is ^, %mm®m 

is!i,@ffMi#7n|[iO(». ! )i 

{H Mlt M W Mffiitkiiffl M flfrft'*, BP 

it® 3-28 
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* 



a 3-28 Hft 


156 • 










3 


Kohonen W\tfa .Grossberg l^^(ART) ,Fukushima |«|*ft(neocognitron)#f „ j$: 

^WlttlSiHM4. 

IH Kohonen ft LVQ Jfjfefcfcl. fe4< W“tt#ifc£”S|$4HlJf TO^ 

min{ II X, -X II , || X 2 -X || ,?, || X* -X II } 

K+.Xj-X* ft* II X, —X II ^(n]»X, lux 

Mg|*3ftW£». 

*ap»^3aW. < B1IS®(2ifc-l)>hmin4ba!^7C. 


36 ft X 16 



rmim 


m 3-29 

64 >Mnffl 3-29 LVQ 

Kohonen 
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■H JlOlXUEXlVUANUJlVlNtiYONC 

4. 

(l)3tfft^#gWi| 

TM: fr§■£ |S] 3£^tt. . S 4M»I6* m*. $ a# 

»,*gfeE,fcg,feaSMRiH. Si«:.3t^^l^ittgW^t*itt 

5£iR0J,82SietZ$?3riii. 

©ftM 

snu^ffl 

ffl; Rrffl3t£$as^ rt ^HScUtt £PU ; g * £ in *2& 

®±MM* 
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% 3 g/Axmzwm 

ammxax 

¥H^j&fflJi*tt4S!f»W^®(liPJ!gffiK>t-)±®f^M,'ei6 

66. 45cm 2 )M^tlS±Bim^WI5[gTO 1 fc££. 104 

ie^T*. mjg.Afr,afctl^i.B9+«E9tia*W 

.to 

1cm 3 W£&Hfifc£3BW& 

(2)^a«HW 

Min 

3tJH#^#{Wm.A#3t3fi-^iSlt3t3fiW^iRl8l^*lH 3-30 flf*. &ifc 

nTiiiL.^aS»#AW5R8i*«ftt. M“o”MT /i -/, gWAWftSS, 

®n"Mfl2-l4 WAIML 
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JfQlXO'EX'IYt ANLTJiypxUVDNG 


«S3fcjfc 


^fU 

m\ 

*m 



(a)jg|«£S5j£ 


x 



(c) fiJtifcfeJSSji 



(b) 


g 3-30 £i£# n mi .§#44 


ot im&n n &&, m %&mw u 5 ,,u mw "as n > 

mm. <• 


q=cq+c(x+y ) 


q = cq +c(jc+ 3/) 


c * 1 &t)» 

c * 0 0 }) . tt*fflW 5 fc»Aafe,-^f£«S» 






nJbfctf-*. 5itTAxttgi*g^w^$a*iJi,5ttt-»J9fsww«FttJi^#a 

# o m0ytim m & , & p *± m 
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% 3 

mm. Siit.w&*tawfti+irwe*r»5M»ifto$£&'>. 

a. ^ 7 t>to 106 bit/mm 2 ,faJ^#fi#B^|'H]S^^ 

tt3®ae(fii^,je«)WiR*i.^^.^iBi«isfe. 

b. 7t*„ BfeiSiaftwit^is, #btii; m \&.m 

'&#£ — o , 

£**§£. —jR^J&Jt«MiJ@.^FftaFftnTSjii09 bit/mm 2 „ 

(3) 3ttt*5 W *& M Bf M4K 

20 M 80 WlO»3.BI##graiftWS*f^fi.*#gW^W2t®ife+ 

^rit3t#»ig.^awMSft«cig. 

7t^f@ mm #m *-t>,-fttme m : ±# w»«@as£ 
it ft & mjtmu $&%, m at-^stmff . s^* 5 t »gtmc«i w tt 
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MINIMA 

WKM IIOIMIRV1 y U AN LU I YInCV O\’0 

, 5j$*m or m > %n > . 

#l££MW. 

(SItH:- J^Ftt 

£Sifc®Fft 

M.E^rw#sw»«iafpjfiEffl3t£#,Ari5itttg 
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4.1 

$i$n,xBox2im#iM Kinect 



(a) (b) 

&m,jn® 4-l(a)flf. 

£#Jo 

(2)?&®ftfgI$I±«lT- > N«^riiiirt«|5#f«lJMF^ Length=3 *£r# 

Len g th=[3,5],MiSip«rM(- > ME$|f!()*a«pfiEW£J9S5->httM!rj^Jglf 

^l/K« 
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■■I JfQI.VlLXI VI, ANLUfVlsCYONG 

(3Teeth=few TO in8#W^*M»lE0l|. 

(4) ^^f+“Length”S^ ; nIlt*nM- > ME^JS- y h^^Jo 

(5) ^# Beak=yes 

(6) *^,&&#Gills=no 

isrj^feie^ je#s , 

mm. a 4-i<b)«swT-«iii[#w*»EWo 
SSiMWM.fig: 

(Gills=no * Length=3) V(Gills=no * Length=4 ‘ Teeth=many) 
V(Gills=no * Length=5) 

Gills=no * [Length=3 V(Length=4 ' Teeth=many) V Length=5]) 

? [(Gills=no ‘ Length=4 ' Teeth=few) V Gills=yes] 

(Gills=yes V Length=[3,5] V Teeth=many) * Gills=no 

imfrmmcA ■ b) vca - o=acb v 

mMo (A-B) = ? AVBS? (A VB) s 

? A-? 

bp£m«t 

mmm-m p^r 
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# 4 


# A^JJr^riEWWWIit.WA^flfMS. I^,A«iT0ftIE«- 

mjEMZfttow&.mR&wr&&jEm- -a^&.ina-^! 

i 

M -fitt»*^^*ftM0*ft«*(inductivebias) . ${fM£T«?S ],± 

#M43IAgjSH4?Jm. 

mz ._aiArt bpuj^*%.. - 444 4@r w 44 

m Ifi) M ^ 4 h -j i£ 44 A 41444 f^J 4IKIE PH (i n s t a nee space segment), 

«±-flrffi W*-#3lwteft£la]44tt4?*M4W©^45$, 3^9 £ 

*8M. 1 

(1) Homogeneous(D) £ D 4 £ 0J M i$ J* j£ 6£ ft, R W 4 ffl 44 IS »J t* & 

*mR, m ii ® m , 4 pi'jM 0 m . 

(2) LabeK D)jg ®*t7£#J3l D Jtf&^ W3$#JJ5?&. 

(3) BestSplit(D,F)ig|Il>&gtfcg£m4Alft£^l8*ffe3i£\ 
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■■ IfOlXI'E XIYV^K' lm IMOYONC 

Mm 4. 1 GrowTree(D,F):^Mi)H^^-^^-^#liEM^S 

HA MD ? miE*F 

Htb T 

if Homogeneous(D) then return Label(D); // AT' Homogeneous ..La- 

bel 

S<— BestSplit(D,F) i 

m d ffc& s 

for each i do 

if Di ¥= ? then Ti <—- GrowTree(Di.F) else Ti % —tTi£A Label(D)&>] 

end 

ii0 5,&?i s&xntimmt 

mm 4.1 

M , 0 AfTA 

tT t£i£( greedy)ftfw 11 !#(:$:# (ft 04 fl£( ftliit 

B&HflJffl® ^(backtracking search) mm * i^^'&tb^f^iiEM 0 SkOLM > fSz? 

m mi¥ m Wit, mm &® nmmmi %+. 

4.1.1 **«■ 
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% 4 */±stM«uMfc3«a 

homogeneous)o Jlfc0^ liii& Label(D) 

&nm 4-1 mss 5 n a 
mn^wm d w#&. Hjtk.ubeKD)^— 

D o *gT*M#li $nM£j*.®£5( BestSplit(D, 

F) o 

^a, d i d, wo,. hums®# 
#W'h£#J,#ffiD+? +fnD-? -^JM^D+WjE«!IWftWJ5fttlJ*WII 
£<D,+? 

IMffft? S&,M««Mi8iAD,+? +=D+? +B.D,-? -=?, 
J&D,+? +=? Rf),-? —=D—? -. 

6^1 (pure)„ «+? +^IE^!jf0 n ~? — 

+f0n 

it. &S)LMtfi##t&nI1tiiBtttilp=n+? +/(«+? + +n~? 

^m#M^P=o^p = i &f.&® 
M;fc/J'*o,Mf p=l/2H^&£Jfcf§*;*:Ct. *3«*ffi,T^S»#i»J£±i£ 

^fScHCminority class ) min(/>. 1 — 

, «BS ft** W® tt® ^ M#* W tkfl»l; W 

&&9E&ftWSHIML&ai% 1 / 2 — 1 /»— 1 / 2| 0 

Gini fg#(Gini index ) 2p(l* 4> 

wjaaa^. a#.ajH^waja«^fi* p(\-p),mmmm^mw% 

(I-P)Po 

^(entropy)—/) log 2 p — (\—p) log 2 (1 — 
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■■ IIQIXOI XIVl AN’l im INOYOSCi 

5,0. 5)£bi*flJ||*{I 0 tUt* 

* M&m , m - mj >- m m 

Imp({D l ,—D,)')='L t J -\jDyI>np(Dj) (4-1) 

imp 

({Di 4-2(b)0fjtf. 



rnin(p,l-/»); Gini 2p(\-p); 

m-p io g2 p—(i-p> iog*a-/»)(^sifflfj«tJ»«®»Bfew 

WA(3]ifcjlW)Gini mm^lrmvpa-p) . 
flfffie.*©—'t#®l. 

Gini /m* 

(D,)fn Jm/>(D 2 )M 0 

MigiifflTH4-i(a)^^aiMiiM^Jt«'J®. sait.axur/aw 

W£ffi!l3fc&H. filSi, ITftfflJt*h, HImiK 
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$ 4 ¥/±at 


4.1.2 rp & 

1 . 00 ^ 

*nna(5jiB+,0is$M^a!M^— mw. iE3i#is®T.mnnr 

Var (Y) = !Yj-Syeyty — .y ) 2 (4-2) 

3^’t' , 3 / =-ppr|-Syey3' V 4 1 pi - V” ftjfr 

? m {Yi. - ,y, > 

Var( {Ym-.Y, } ) =yS >e yy -2^.-^-^; (4-3) 

$[# X6R 

Var(X) = T^j2x6x(^ — .r ) 2 (4-4) 

^’^ = W Sx6XJ: +0fettw^<i. mjf(x-xy=x 2 -2xx+x 2 .m 

Var (X) = T^j2 J .exJ : 2 — -r 2 (4-5) 

Jiff: 

I j^ i 2 x6x(^~j ) 2 —Var(X) +(x'~x) 2 (4-6) 

^(4-6)^lUto,^H^7*^(4-5)Pl^q,^ r S i6 x-r 2 =Var(X)+y o 

I X I 

X +ff*W>h7C|fW^*lldi^rll» 2 fg : 
yjp2/6x2, 6 x (*“* > 2 =Var (X) + 7 ^ 2* ex (*' ~x ) 2 =2 Var (X) 

(4-7) 

^XG?" fc—frf Van' 
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■■■ iijQIXl'EX IV 1' A N1.1JIY 1N G V O'* lj 

<x). m&mij£2.m2uvar i ixm&%x = 

1~j ^ X £xx\Dis <malignmark -/> ; X — XX-*■? 

2.mmm 

* m %&&&—&%!&*¥% IShSS* ft. 

M-*yft.*<nnT5lAafeg»:i=-rjrS rf xJ:\Di*< 

malignmark/>iX~ XX ►? Wj#*#*,*' 6X-^R»1K 
(dissimilarity) ,j&# Dzs(x,x')ft{lLJi:fc,x fO — 'f' 

D (cluster dissimilarity) pT££Titi+1¥: 

Dz.v(D) =-j-^pSxeDSx'eoDzi (x,x') (4-8) 

(split dissimilarity) Kf GrowTree |fJ£($ft4. 1 ) 4 1 ft BestSplit 

(D,F)MMffl. 

MIEft^r^fn,, 
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$ 4 $/£9fcti«l«l¥3tta! 


mmffife , mm bp xmmmM . ■ 

mi #*m msii , immm . 


**«*$ 1 

5 ® . 

fa* 

B£ 

■HPi 

yes 

agj®W5iK 

18 

None 

sts: 

±* 

no 

23 

Premium 

1S2D 

*)I 

yes 

24 

Basic 

5® 

*51 

no 

11 

None 


fi£ 

no 

18 

Basic 

m® 

±» 

yes 

22 

None 

1 ® 

B£ 

no 

12 

None 

; stf 

mi 

no 

19 

Basic 

JS36J 

BS 

no 

20 

None 

e« 

BS 

yes 

16 

None 


a 4-3 

JUral 




«in ftiit* * « s * -'Wij wur^fflia, «.& »«$# 



Mim75 

Basic 

None 

None 

Premium 

Basic 

Basic 


None 

1 

None 



:i - ;• 1 _ ' ^ _ ': 

None 


None 


S 4-4 


• 171 • 






■■ flQIXUEXrVI AM lllYlNGYOMj 

MM®. TMtttftfhtB. 

(1) M*M 

o,in#*r 4 

^nTHHSifi 75%,SM^^®^7 0. 75„ 

(2) 4® 

®/P, ^Wit^^^P=-Pxlog 2 P 0 

(3) S/g**EJg^4®*frtfc 

(4) ff.t^^ 

fq« 2 ,PJW: 

= E([7? ~(P«l X£(M])+Pm 2 X £(«2)) 
£nJli(Ml^I^«. 
m p«, Pu 2 

P«i =Szz?(mi) / Size(U ) 

Pw 2 =Szze(M 2 ) / SizedJ) 

W,±«MT: 
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$ 4 #/±;7fEMmiS^35«ia 


&mk'u(D©m#, aMMitis <o„ 

$MT:rc_hi£'£lSl./5 '^Cf^Jia/ii T—*i?dIS 4-5„ 


h 

**a«r r' 

PianKimi Basic 1 SittfMO? None,5 



a 4-5 


(2)®firisrtt 

ft) 

(4)iti»®ifti 
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■HI JI(?IXUl-:X!YU^NU)IVINtCiVONG 

A$?AT 

4.2 MMiM® 


m ?ij w&si m nftr £ w m m # 

Wo ^^ : FtW^SytPMT^5lJ^(discnminative)M«i!lo 

P(Y\x),n^vx%#&. ip&£ x 


B<t unrig® y mbm. 


^-A^ISW§y^/ A: ^(generative)mSyo Ji g «* V 

^p*±,st p(Y|x)=s y p 

(Y=>y,X) 


PCY'I y \ — P(Y,X ) 
i(y!A) Z y P(Y=y,X ) 


(4-9) 


Eft, st p(y,x) =pcx| y)P (Y)S a 


M+aii*#iEWTO«swif**. jikft.«ffHfe«r«cig P(vm^» 

Tf-WsE^e^SI)}S^W*P(Y,X)M^ PCX), Hitt .(*TfflT#iE»IB.<B 3 E 


0PETER F. M»3[M], dfeJSC: AR«**#thJKtt,2016. 
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$ 4 #/±Sfctt«lB¥3«& 

ami*. m* 

«FfiE^(IIWSIia:tt>.liSf-Ma#fia^^«F^|5i*l«tt«p/Si,»^»ffi^ 

Ut«ttP(y,X)*«W#flH4»^W. ^M.AfflxtT 

Tz^mm, p(X)wriwa^iiiTAflameisj* 

smite. 

4.2.1 A,T=r A X 

gStefilWJRjS. »RSRI f t I *#J8.W^Jijl ; fIE^#(normal distribu¬ 
tion) (Gaussian) 5 ^®-%— 

M3SMfc«j6fll#iniffi3M5ft. ftT3|£,*ff]t5fettifeW^1il^TW-7c» 
fitt^ftJRKM^ti^MCmixture model), BP 

component, m^mimm 
(Gaussian Mixture Model,GMM), 

m't'frmmmmfriu. mit* 

p<x| ® ) "yife $ ' xp (“'5‘[^J) 

P(jr le> = y?b 5exp ( K^~T) 

*t.,* »«• »*l*iE*W^«*#«*.iB/.*»•* 
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JMJIX URXI YUAN 1 l/IYINQYONO 


M -°> 

j»^:(4-io)+w»»3iilg[fls* 

-^2 [ (or- ~p® ) 2 - (x-/ 2 s ) 2 ] = [x 2 “2,/® x +y-<® 2 - (x 2 ~2^x + M * ) ] 


ISllfc.fm^tfcnT ^TK^f LR(x) =exp(y(x- ( u)),^4 3 7 = {fi® ~^)/a 2 


+v°'>/ 2 

X JR*£H*,LR(x) =1)* xML=fi 0 




WP. 



a 4-6 $-!**»#*.**& A ] 


m 4-6 4sWWft& S x~d:l. 85 

* w ei'b] c -i. 85 , i. 85 ], m&t&mwi 

4.2.2 
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% 4 

X, o ftfiftHCbit vector)X = (X, , ■•• -X* 

WIffiMIt k nifiltta.lt k £Wfr 

[6is. bp— r-ts^ t ma* «4i 3E& 

m9c®xmmft%&&r9E&k. 

m Bf ^fffgi5;(naive Bayes as¬ 
sumption) . &&w *gga!+,BP7 |h]M* 

iKSfaifiJi+W^^J&SEitSliiW . 7 Ji ft (X,, -, X*) ft$ 

te67^^ficff]B^^^MEfe7ifiP^ + ^#T^isI“Viagra”.WlJoTW5^^ 

i. 

immn e ^si x mm r- ^ nr mm si . & *hh >*>,«fn 

p (x i x=s/>a/n > fo p c x i x= 

ssffflt®*. Hjit.jitTX^^^iWft.afnnri^Btfitir pcx= at \ y = 

pamm P(X=a, I Y=ham),# 

M^fW^(XfL) argmaxy P(X=j|Y=y) 
ft*JolfcllE$(MAP> ar^xyP(X=x|Y=;y)P(Y=:y) 

^ argmaxy vuy PCX =j: | Y =y) 

mm^&mmz\'m&%&:ML ^m^ift=p^m^T^MAP & 

M &-)£u 
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■■■ JlO'NUl-XI Vli AST. IJIVINOVO^G 

2. 

gmimamY «ii,at]«5AS 

m%m^\Ammimmn¥-m, 

m&,mmmmmm\$]E5)U+\)/(ri+2) 0 iAw 

ibm. *a^witaT.»fnpriiji§iAH^wi6#iaift*«»ifi3fe»w»Bfl. 

£ta*/'NS3!l4 t 

(c/+l)/(n+A) 0 m / fci’t''#(77i— estimate} m fO 

0=0 j£0 = l o 

»«w^j». h ttifetts.. m wa c*iEfli#sw«^tt 

mmummmmim, &&&7®;im am&x -,%-irm, mwmm m «h* 

%tMM, ffl Jiiiffl S'N&SWWfr . 

4.2.3 ^ 

*/i'i!ri»i?^»*#ja.w-#^»J^«tai-—logistic 0U3#i§L mm 
•logistic 0!)3(&*»&£,&05-*t 
logistic logistic 4* — 
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$ 4 $/±aEH«L»¥3*£ 


ms logistic ni!ams!!0yi:^^^m®it^c 

logistic 

tt&#®#£ijijsMKai(inffl 4-7 0 f^) o 




( a) ( b) 

® 4-7 (a)logistic ©!»3«4!W'l±j|fe*i±7A-^«,'lit^*ll«t^L|L'J' —* 
if ; (b)logistic 

4-7(a) + logistic 

IS 4-7(b) + ,^fflJJr®^ttttigft-^(a)*^ 

n, logistic ®!a«a!Wttiia ; f^^w#-^ra,H*'ea ; F^ 

4.3 

ifxf faltf/USupport Vector Machines, SVM) 

#**#$?+, K^ttaes* 

^-^aaM^wag. 

4.3.1 

#3 . tevusa, mmfrtt 
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■■■ NQIXUF.X! VL'ANl IllYlfcl.YONG 

^wjsja#.«?»bi*4ha^i4ra«±.w*»M*^asw. 
mt m««. 

m§ $ in ®xt»«Mx «saife*a! fft. n . 

Mf#t£ M 

Vapnik % AiH Hi gifcJi-#1r f J ft 'h#*Sifc. *£«& T A 

ai^^jiatirfrjiifW'#*w^.iiijB^(5iew*#aife. 
«.Si6MM£o STii—Sifeifi¥SHiWil#ftJ|tn,^rj5fe,*»ifc^^ 
ttfRISWJ—tKr®j^o 

« 20 IttfB 60 w,Vapnik yJiB^T^tif^^ . iPg 

/JvfcjgjqaT££i+^>J-SSctttfj&#(HJcatt,IteaW nJ&tt . tea -5 

20 TO 90 —SVM a& 

1. * 

p {(x 1 ,^ 1 ), (x 2 ,^), -, (x>,dn, •••, 

(XArf p )},)?mi-$iiA#* X',g$M$iHi A d" = ±l,$HMtt*W£W£ 

WPX +6=0 (4-11) 

sS+.X AM Afri:,w AMfai:,6 
C6=-T),PI!IW 

W 7 X p +6>0,^</ p = +l 
W T X'-H><0,S J p = -1 

* A^(4-l)gj2.Wie¥®-^*iSW#^^:(SIWraRS»*^A3fia.ffl p 
a*. i^MmwBissteia-^AiaaaAMie^w.BPaffije^iii. 
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% 4 #/±zSW4aSI^3]«S! 


IH 4-8 

MPff- 

W r X„+6o=Q (4-12) 



a 4-8 ifc+tf+tfjMfcfc-f-® 
WJX +b„ 

r Wo 

frMmmmt 

g(X) =rW n =WZX+bo 

tnftM. X fio 

^•#ij S'J ® MftUa-'it, M & 

,W T X>’+b>\,^d p = +\ 
<W T X' , +b<\^d p = ~\ 
p = l,2,” m ,P 


(4-13) 

(4-14) 


(4-15) 


IJifffl5fWliifiW^#* X. i£g(X.O = l.fjc*£#|n]*. 
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(4-16) 


NQIXUiMYl ANUjlVINGYO^O 


d p (W T X P +b)>\,p = \,2,-,P 


W 0 


~ ^ = +l,X J £Aflc*i¥®iftjEffi 




(4-17) 




p ^= w 0 


(4-18) 


II W llfc/Mt. H 

ltt^£j!:(4-16)M^Mft II w I llWMSIllIlltlll. 

2. 

M±®mtifc, isjHnr u 

EPMT^^WiJll^#^{(X I ,^ 1 ),(X 2 ,^ 2 ),-,(X%^),-,(X p ,c 7 p )},^ 
PJ*sm®*wfqJS|{lT W*tt®.ffi^*S(4-i6)W^*T,*/h4fc{tffr®» 

$(W)=jW z =-~W T W (4-19) 


ttW.SjfcTOffl Lagrange Jk9LU&im& J5fc*ttf5|«. 31A Lagrange 

JPT 

L(W,b,a ) =yW r W-S?=ia,[^(W 7 W"+6) -1] (4-20) 

^4 5 »a>0,/> = l,2, — ,P^^7 Lagrange ^(4-10) 1ft® 

» ®(W) t m&tM'hik $(W)WtVHkM lc Lagrange ®»M*/MI. 

ffl# Lagrange g#^rUJ;#Hl,a»:ffiaa»®A/jN4b,iSffi!S—5li<P(W') | ,i$ 


• 182 • 



% 4 


9L(W,b,a) _• 

3W 

(4-21) 

9L{W ,b,a) =f) 
db 

W = 2>=,a P ^X p (4-22) 

flJffl^(4-10)W^(4-ll)Wr^tb^^# 2 

2£=ia,</'=0 (4-23) 

L(W ,b,a) =\w T W -tapd^WW" -bta P d p + ta P 

, 4 p=l -p=l p=l 

M^(4-13) 18^(4-12) ,0l#±5i:^^ 

UW,b,a)=^W T W-W T £a P d>X l ’ + £a P 
Z f>=\ p =i 

=\w T W -W T W + £a P 

Z p= i 

=4w T w+£ap 

z P=1 

M5£(4-22)pmflJ 

W 7 W =W T Z p P = }ap d>X 1 ’ = S£=, Sf=,apa^^ (X' ) T X' (4-24) 
Jg ift. ® * W* /J'-fk L ( W, ft, a) * ft ffi] @ft % —ft * ifc ® » Q() W 
“5ttffl”|5IH. SP•. UX\<P), (X 2 ,^ 2 ), -, (X',<*'), 

(X p ,d p )} ,^c^f^^(4-24)^7^^;'®M Lagrange %.%. (ai ,a 2 >a P ,ap } 
J#M^£&#E;-iB J ^ # -0»a^,p = l,2,*",P o 

—)X®li(tR(tf 5 ]^(Quadratic Programming, QP) „ 
* Kuhn m Tucker ^Sftl,^(4-14)W®ffi:#I^MJ£WT*ffi^ft(KKT 
&#> 

ap[(W T X p +&W'-l]=0,/> = l,2,--,P (4-25) 

TOJiap **#MOT r X , ’+&W' =1. 
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■■■ HOIXI'E MYI' A>Jl.T)l> INCVo^C, 

Q(a) * {a, ,« 2 .a, ,ap }. oriiil5C(4-22)ifi:*ftIX{il^i] 

m , £'1 * W Lagrange % & , H jfc 

Wo = EJ-ia//'X'=2 W r**a,rf‘X* (4-26) 

rfo=l-Wo T X* (4-27) 

**^ttRT4HBiia»ia YA gft* 

/(X)=s*ii[EJ=ia,rf'(X') T +Ab] (4-28) 

P'NIfAffl®* Lagrange 

d p (.W T X p +b) ^l—£ p ,p=l,2,'”iP (4-29) 

j £'* 3 IA T MM f, >o. p = l, 2, •• •, p , •£ fnffl ■»IB * Bl 
aa&&#8HBUSS«. Hi 0<^<1 P|.M.4^A^EfeJ(M|L]§p,E.^^ 
^aTOWjE«i-i8»se A >t 

i (x 1 ), (x 2 ,<?),-, (x>,«p ),-, (x p ,d p >}, w 

»WfP^|TMtft{l.f^(4-29)6flW.l/J'MfMW 
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$ 4 #/±SiE(i<jM«S¥23«§g 


4>(W,f) =YW r W+CS;=,e, (4-30)* 

Lagrange £*bm#Jfe£l3fc*ffi|5|H. 
A Lagrange gfttt.ffi5£(4-20)+M 1 

Lagrange llifC^j*/ 

L(W ,6,a)-=|rW -'Z p p=i a P ld p (W T X“ +b) -1+$,] (4-31) 

W^*:^^i)l|^^^<(X 1 ,c/ 1 ),(X 2 ,r/ 2 ),-,(X%^),-,(X p ,rf p )>,3jc 

Q(a) = Sa P S ’Ea P a J ci /> d J (Xn T X f> 

p=] Z p=\j=] 

%HAlfilM Lagrange ^ffc{ai >a 2 »*•* .a, ,ap } 

Sa,cP=0 

p=i 

0<o P <C,/)=l,2,-,P (4-32) 

nfKJl#ttj*±ieifegtt+,fe5ih$* $,,/> =i,2,-,p fnfctfiw 

jHtfh.W WMfAif'MriSW KuhnTucke 

ap[(W r X p +6)rP-l+£j=0,/t>=l,2,-,P (4-33) 

(4-26),iS:(4-27)fn^(4-28)^^:^|l] 0 

4.3.2 4M£tfc:X3^jsi*;tn. 

£#fc-i#LW 
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■H IlOIXt'tXIVl AMUJlVINOVONt, 

l .IfrtSfWiWI 

T$tx %J N iiA$|aI65^i,^ <£>(X)=[y>, (X) )9 >2 (X),-, fM 
(X) ,7 ^iAHA^falSijM X ft 

Sf=i^ ; (X)+6=0 (4-34) 

Mo ^(X)=i, W0 =6±js:oi®^^ 

£7oo>,$ ,(X)=0 (4-35) 

W 7 3>(X) = 0 (4-36) 

#it^'ft nli(:%1 A S fa] W it (4 -12) ft #II ^ I'H] 7 ^ aT ^ 6^) 
‘IfARffiffl 4>(X)#mX,#PJ 

W^E^ia^X)' (4-37) 

^±itttA^(4-26)nr##!iESraW^S7ffiA; 

E?= 1 a P rf p $(X)0 T X' , =O , (4-38) 

it7,<£(X)<£ T X' */K3H P ^$&A£j£ft#fiE£|S]M# <P(X')i5$jAfr* X 
ft#tE^fa]M®<X)^rt^,0itbft#tiH^|B]^3tSttS^ffifft,ttM# 
ffi^|al7W7IRo ^f^PJ-7S^K().f^# 

KCX,X P ) =4>(.X)<P T X p = 'EjLi<PjX p ,p=l,2, — ,p (4-39) 
PHJft#fjE$ra7tft@7ffi0^^%lf^m6^^o #^l*llRMfS(o '& 
Mercer fem%&ft%mmm£{ t t-.K<iX,X')m7K-'i'&mmt 
X^ftfflE|a]a<X<&,X'|l§fl7 MMK(X,X')nmiIff* 

K(X,X') =2iS=iAi^,(X / ) (4-40) 

StMM#JA7 0 o mjHit(4-30)-p(M^^^f7^ 
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% 4 


PP K (X,X' )<P(X)G>(X ') dXdX' 5*0 (4-41> 

J bJ b 

ItfMiS fV (X)dX«~£Kj<l>( • )j&£ . 

J b 

K(X,Xn^m^M Mercer 

ftWfrffiUo Mercer 

K(X,X')M53fc£J*Je. Mercer £S, W 6 

[±Jj®o Tffil&di 3 ##/8W«iS*. 

(1) £«M& 

< K(X,XO =[(X • X')+TJ« (4-42) 

lfr^5J;#3§#,3t+ 9 

W#ft. 

(2) GaussM$( 

K(X,XM=ex/>(~^ X ~J^ 2 ) (4-43) 

(3) Sigmoid 

K(X,X')=tonA|>(X* XM]+c (4-44) 

H p p =\apd p K (X,X P ) =0 (4-45) 

/(X) = i gn[E;= 1 ap^ p K (X,X>) +6o] (4-46) 

/(X) =sgnlZ%a s d s K(X;X s )+bo] (4-47) 

£ o £+BUTnr£*fA#^-^-«^ fIp]# ft ftIRMft, MU m=ff & 
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■IB HOIM'KXIYI' ANLIJJYINGYOMG 



a 4-9 jt# 

Mercer 

«»Aft**ZJ|^ffiWl*3Ji X=[xl,x2]T,#W 3 

®(X) =[95, (X),p,(X),-, 
?m(X),] t 0 iS#X(X I -,X > )=[(X i )T-X i ]2,ffilftlt<P( • )fkRz^R 3 ffi£ 
[(X,)T • X,]2=3>T(X)$(X) 

^T^JWTOnT^O>(X) =[ j -?, 952 (X), 933 (X)] t ,^^(X) =[9, (X) ,<pz 

(X),< P3 (X)] t „ 

4.3.3 

(1 $ mm xMmmmmwmzm, 

mm*]%i%i ! tZ P p=>a P d>=0,0<a l ,<Cl$U ap >0),p=l,2,-,PT#M 

Q(o)=2^ 1 a P —|-S^iSf-,a #fl ^4> 7 '(X')4»(X') (4-48) 

JI^'f-fcfKj a/> o 

(3)i+jrSf£*x{t 


188 • 










$ 4 


W 0 =SJL,«//'* (X') (4-49), 

(4)Xt^#^5£ X,Tf»#^#!lSiJM 

/(X)=5j ? »[2^ 1 a^ /, ^ r (X p )^(X)+6o] (4-50) 

*ig/(X)*i^-i,jfc^xfl9ii#jjaji. 

(1) ?f£ilr—£liJI|££#^ {(X ] ,d l ), (X 1 ,d 2 ),•••. (X p ,d p ),•••, (X p ,d p )} 0 

(2) MMIt^i«/=0.0<a f <C^( s ^0),^l,2,-,PTI 
$?f$ 0 f/FB§iSt 

Q(a) = ££=><*, -{S^, Zf^atajdWKCX^X ') (4-51) 

K(X p ,X),^,/=l,2,-,P,pTWWJiPxp^^ 

mpj 

(3H+nmimm 

W 0 =Y,Uapd f Y p (4-52) 

(4)itfiM^ xAm^mmmw 

■f(X)sgnlE$-iaJ p K (X,X>) +6 0 ] (4-53) 

«*/(X)*iai-l,*SX»#|»J!B* 0 

® ^ iy w i & [nj m #t4> * ® ft s ® & m st m -ip-*e fn w 4> -6 ft s y & £i# ft t &^ 

rbf 

H5siR. 

tfc. £3t fa *#l ws 


• 189 • 



■■I JIQlXlitXIVL ^NL»J(VIN(jVO%G 

3 m&jag&wxMi&o 

(1) Vapnik 

m . t j 1 w# £ & ® m ,#mm m%m 

m. mmifc 

(2) Qsuna ^Sltli 

ii/hfM^t. $& Rttxft m +w ftm m , w m £#x# 

*. «jmtt£«^Ta£-#J^WXft:#2M!&##&. »#&*£& 

#W|SI«*:©JSZJ 8 KKT tt^^f^li 1 4 J 1 f5]@M^X^^;(2)X^*iJl|^#^ 
Wis#*-fejfiE«iiE^irfettiiiBca. 

(3) Platt M SMO^j* 

m &j qp 

SMO(Sequential Minimal Optimzation)^fe&9l 
ft£\'B\R&% 2 X#*.£$-2N£tt&m*r 2 x Lagrange 

jitajtfe+Hii-affir^wej^^sitffiiiift: qp mni. smo 5 ? 

Btlaiffl*rW]!rft o 

4.3.4 

rt SVM W&flJWftfclBT«£«ttM^#toS«.fcAl&fc» 
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% 4 $/±jjKM«lff¥3ttS! 

mzftim&wtt'mtom&i&mwfi'rt svm 
l. ADm-^?® N^ffifniR^y 
Osuna II# SVM jfcjfl^f AM»I 

SVM#^^jfcAfl&-%#A&Si#£. SVM ttiii|*Mt£ 
SVM 

SVM SVM ffl 

&m-wm& svmm. 

«m, ii?* wtsaKWtt * * iA»mi svm s-g-wps 

£T.-^“g#(boot 'strapping)”^ffi^^PT^#5lJiJI|i^^'f4 SVM 

»,##Ht«¥WMH;3!l 1.67%. iMf^IM+tlliifWAlttg 

7cW^^r*fe. 

*Al^d4*.ffi»1#ffiWII«t5ftiR»jRr^JiXt 3D$H*M 2D MS 

imim KWftffi. 

-*'Nt£. PC A H SVM *g£g£iftAJ& 


®^ii,tush. STS^asw^ttWAttttaiDiaf^A^^aiRitt^iR), 2003 , 

43 ( 1 ) , 35 — 38 . 

®),2003,43(1) :67-70. 

®*»**.«i*E-.iH-JII!IH.* ; Fii»fi*W,ttA»«aft*[J3tt^^»*X8.200i,30(5): 

318-322. 

ffi, 2002,36(6): 884-886. 
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■■■ JiniXUeXI YtjANI oivixovoxc 

pca &m svm **tg/h# 
i& svm 

bp m&frmmMmpM* 
pca 

rtmm 

svm 

2. iftr£A/®AiR})'J 

miSAipj'j® ^ T&mm Ain^wfrmm. svm w#&#. ® 

*ii£Mi£^«uA #* 0 *Jfc.tf$MF* 3 IA» 5 S 3 fci**£a! HMM.g 
£7 SVM *q HMM M£1iSL HMM S£At3£9Hi^,i!if SVM ii£7 

^m ; hmm m svm 

mt A7A®^ HMMfflj®ffi^«a,t5fe«F svm 

yoho»«s,«mehjr*m 12 mm & 

mm&M 24 $&£>£ HMM Til SVM ft 

3. Jt7/7¥M@] 

2 .5 5. i%(^tfJffl7 

AttftHWJ.Mffi 3 # svm 3 #ft§gft)ft$Jftg$$M2r 

4.0%, 4 . i%|n 4. 16X16 W^^ftf^**A,<lW 7 

SVM 


*111 PCA/1C A mE*n SVM 4H6WAIMRMD]: it»l/LMlVi t5i+7f?I 
,2003,15(4) s 416—420. 

©Ur*.«£#. *^0¥«7 SVM- HMM «£■*£»«« AaitfJ]. 

31®^$,2002,14(11), 1080-1082. 

uk ^anaasb^wiRiew^fltft^iRSi.dfcscaiA## 

ffi, 2002,22(5): 599-603. 
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$ 4 3/±8ktt«ifl5*3«ta 

uk &mm svm 

iRS'J^#. £*h ^.^U'riPMm • Mfii T-# $© SVM 

«?»«#] -nm^mr svm 
4 . mm m 

m&m $® « a-# i?i m&m %, bp &$£[&&, * 

«$. 

j£8©3s®Hii}#£ffiT£f : SVMGm^^ft^ftfnil 
mwirm o nxn 

««peEj^ffiffl«5feiiii^w svm 

&%. ^SsMWiTWW. 

(3). * W*#li s&ttM®fttffiEfnA0r««BA 

fe,3KS^®m svm 

iiMiitw.tii 9918 


©ji^.£a:fc.?Mfctt*-tt*^:£#fi*in.«¥^«^iR8U:fr8s*?#*.2<>02,30 
(5):651—654. 

2002,14(5) s 1—6. 

ffl 2002,14(8) il-4. 

){g) ,200242(1) : 80—83. 
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■■ HQIXUEYIYCMNL iJCYINCiVDNG 

0 hu 3D mmwm&$Lm*mr ; £t , s ^ 0 iith t-#*t svm # 
*gfui 3D3D «#$ 

svm &friR#j-*m«. 

3D Lillffa WJteliPJ 1 !'t, MT . 

5. SflkJSffi£flT£ 

(DiT SVM ,£M®F£SHUS HB tm MSr ft . 

&i+#£3ET-#ST SVM #£tttoH&Attfc#J£&. 

IMMSreP^b TCP/IP W«E*#tiE. ffijfl svm 

tcp mm. $^#^ 93 ,tcp 

(2) p-Hiifis*«,fiss*8ffl. svMiatT 

BP,RBF,PNN fq LVQ 4 

SS&frtftt. a^TIffl SVM||rlA#ttlI9!ll». 

(3) ^SS*49®||dJT-#J» 

svm svmto® 

i. a»fe3te^J«7SVM®fl|^S^J!l*|l^i**ttW«:/l5i 0 


2003.15(4) :61-63. 

©Bfefc£.3KTM,$ft. ST SVM&*^Aft*»S*Dl ilf&£», 2002,23(5) ,51-56. 
2002,39(9): 1082-1086. 

2001,24(1) ,62-68. 
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$ 4 4t/±stM«iMt3j«a 

lRl*«l(LS-SVM)f^*^». MtiJT LS-SVM 

DAG (Directed Acyclic 

Graph)#^M^LS-SVM^®^ 0 M26 'M 2 WMmK3'J . 
«»#.gI»I*g»Wi&^^r»tfc«!.LS-SVM 93. 62 %„ 

SVM^|igg^|&]±-X 

h mr&. 


©^j-a:^,i^fi B n p.e^. A#iaa:w#5S^»iR»j*tt[j]. fc^abteie-axE, 

31 ( 6 ) : 499 — 503 . 
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5* 


5.1 #l»3*33Wfl5jfe 

SiA 20 Iftfi 50 

fcte*ra,nm«#*ia > mg. 

smi&m naMM, »,jp*«&iii^-ffl]w*,->hsfliusiiix«t0[ 
tin a a #«#*{*:»£&, bp^m 

iftpi^wsstfnflwii. & m $ « /a $ ± ® m t n tk m x ®f $ * % 
tfeWfiaij#»»ac2ES8EWtt^tB*,fc^waaR. »& 

Wtt3H£rf£A Samuel WTiglf. 

*-BfraS* 20 fi«B 60 ^t4>nffj 70 

iie, m^txmmmm^ mm vm&m&m 

»w«{i m< m& o am-a® u Amt®ra 

m,%-iTMmm±mMm®i?mmRi)nAm^3km*, *&tm. itt^i 

fNf Winston Hayes Roth 

mximfA 20 tttta 70 so fettm 

pm mmiiMMm#. , mis amm 7 #l# 3*3 wnF&fn & 

1980 
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% 5 


A3io Jlfcfn .t/lf^AI Pfinllrf 1 ^ AilMfSfflo Strategic Analysisand Infor¬ 
mation System 1984 Si¬ 

mon ^ 20 ^fiAXlli'tlsA'^^IslMA^XffHj Machine Learning 
iBlR.BII^tt^ Machine learningWJ 

JK&&. Mostow tfj^i^^.Lenat 

£Mf7, Langley tfj BACON &&&#&& ffl ¥. 

^raimA 20 tftffl so 




5.2 ^ 


jm l 


5.2.1 -=£-4^45.4#-^- 

$. hlMMift M M # /&. 7 #f M ft A IE 00 fP JS 00 * iJH *$-ft 5>H 

«S. ^M,KfflS7iiJA^^fteiJi|i1i#^,4t^A^7PEl? fll*tB#Hl!iilM8P 
MM_m? 

^ftj&#^fn^iill^#^:ft D / ={{x„y 1 ),(i,,x2),-,U,3»,)},a/ 
7#*M#S#J^iE< BP H £M) Bfcl, # A*‘7f7ie”(labeled)#ft ; jtfc^h,j£W 
D„ ={xi +l,x; +2 .•••,.17 +«} ,/«m, li « BP7£0;f! 

5M).«C A" At7i£”( unlabeled) #ft 0 - A® • 

ft A. pi'j Gtfr * mT tt sit! k • d u m&i$ w in .gjm & t , %■- a is , * iu s 
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mw^sLmR&m 

JIOlXMfXIYl AN LI JI YlNGYOWC 


SiJU^o 

&BJ6? 

».^j&ffi&^»^w^rlSTa#^JinA?&'f’S:*fiiiiai-* > h*S!,#*MA. 

. 

«jjnii^itiitkiKawii,w^tsTOie^^. 

“ 31 -9’’(activelearning) @ 

«F3g*“Y«!”,^H3llMm? 

iistttnii. ffl5-i«&aiT-tiiwj/7. £#*^ffl+to- > NE 
, uij * ^ iE+ra, »g 

t^Mfij ®+ w?MSie#*, mm&^mmn m %]ew . 



• • 
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% 5 

(Semi — Supervised Learning)® 0 

ll^iS.Hilfc.^#iBW5f#^.<i5:«W±#ft^#W3ffnrf^*j|c#Ta# 

■ £#J&TE*]fc*«MSi£. *#ja»S“*^ffia”(cluster assumption), S|lfgi£ 

«TOJSTIE^. ^H£#'^>J4 ) ^-^^iaWfii5Ji“?j?i^fgi5”(manifold 
assumption), ^’^fl^1^±.?|5ifiW# 2 l s: $lW1 : B'f()(W$ttf} 

u mm m a *m* its «t m fb$i , m jit 1t $ % m a w is «m si m r, n m r m £ 

(pure) (transduc- 

tivelearning), |(J ^ffx^ijll i%. W. Jg 4 1 W % iE# $■## f# j®| W $E$i - M fa # 

w>i . &m^n kk 


tf-*#l#*.2015(8): 1592-1617. 
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UOlXl'EXrVl AM tJY9VHGYO - 



a 5-2 


5.2.2 

generative methods)^^gcS^ 1 4/35iittliy^J^rS:o 

iEUcig w^iBpj «i#f^^s!Maifc^#a.ii#nrsT em 

it #Mo • 

m 2. • M#«*T£nT»'^Jf M: 

/>(x)=Sa;* />(x|«,,£,) (5-1) 

1=1 

a,^0,S, N =,a,- =1,/>U I^.Si)^#*X i 
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$ 5 


fix) —argmaxp ij\ x) —argmax'fl piy = j ,0 = i I x) 
jGy j€y *=1 

N 

—argmaxZ,piy=j |0 = £,x) • P(0 = £|x) (5-2) 

j6jy 1=1 

' 

P(0=£[x)= ( 5 - 3 ) 

2 a • p(x|/i,, 

—- i*=l 

i ©=£,x)^x 

wi$. 

pi y =j i 0=i,x)fc5w* x 
^^Mmpiy=j I 0 =£,x)ft#o 

t . ep p{y =j 10= I) = 1 MiM MS £ =j , 5 9UJ p {y=> 10= i> =0. 

«M^(5-2)t^if.A(3'=) I 0=£.x)fBfcjt#*M*5?ia.BJtt{X 
/>(©=£ I x)^^&#^iS,HiltW1iie»^#iE^ 

D/ = {(xi .j'i).(x 2 . 3 ' 2 )» , "(x/,>i/),}flI^f/^iE# 2 |s 
Hixi +1 ,x/ + 2, ••• ,x ; +«} ,l«u,l +u=m. i&iSiFJr^ . ii 

{{a,,«,, 2 i 11 «£ «N}, D, UD„ 

LL(D/UD„) = 2 ln(2a, • />(x, |,n, ,2,) • /»(j> |0=*i.x>) 

<*x.^)6D, »=1 

+ 2 InCZcti • pCx/1^,,2,) (5-4) 

X(6D„ i = l 

y,j = N a ' * (5-5) 

2a, • P(x, |«, ,2i) 

;=i 
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(5-6) 


JJQIXI’E.XIN \ AfcUJIYfMGY ONI) 


p, -v J i / ( 2 YijXj + 2 x>) 

Zj 7.y+/, x y 6D„ x r y i &D l f ' y i = i 


2,-yi—— TT( 2 yij (Xj —' Ui)(.Xj — Uj) T + 2 (Xj ~Ui)(.Xj ~Ui) T 

2 7,y +/.• x^efl. x r ^D,hy r i 


(5-7) 


a, =—( 2 y,> +/,) (5-8) 

^*^(5-3)fq(5-2) 

^±^i3tS + WR»^gy^M^^^S(MillerandUyar, 1997), 

+h*Jil (Nigametal, 2000> ^ W i* ft # ft gflfe « £ JdUt 3. 

-^A^^!(iS5)' ; i ! tJ^!In'; ; S ; PJflJffl^ i tei2lci(^SiS | J#l ! ^fftS / ft'ttfi(Cozmanand- 

<>)hen,2oo2),itiiw*.«3gKCffi«- t t i ffiffi«#<f5fettai®«iw«iai!«,i» 

5.2.3 jsiT**m 


Shahshahani and Landgrebe( 1994)® 

$I«. 20 tt£*,2l + 

Sl^m^^^(ICML)^ 2008 if ff&iW'+if 

2008 if (Plumand Mitchell, 1998), 
2009 if(Joachims,1999),2013 if (Zhuetal,2003) 
fettiSilft-¥-(Shahshahani and Landgrebe, 1994) „ 


©BELKIN MP, NIYOGl.SINDHWANI V. Manifold regularization: Ageometric frame work 
■ for learning from labeled and unlabeled examples[J], Journal of Machine Learning Research. 
2006 ( 7 ). 7 : 2399 - 2434 . 
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$ 5 


IPl'O. continuation) iAffci-k—'h itf#- MIS 

*& M S3VM s # g Uc (Chapelleetal, 2006); f£5j| £ttil A 

(deterministicannealing)il® ,#^|£b —^^ij£!]f^;|'6]@, ^ J| 

I'Jj!f0^^(Sindhwanietal,2OO6);flJffl CCCP :frj£{£tt#ftM(Collober- 
tetal,2006)^„ 

(Blumand Mitchell, 1998)„ tri — training)f^^H^'^^^,ifiil“d' 

and Li,2005) o 

^«W«««*®*(Zhou,2009). 

(Belkinetal,2006)^;^i!S#^^ ^SIlB TIEPJf-t(manifold regulari- 

mm, tk-t-mmm 

^J«^^,^lftH»i)l*S*MS^/t«(Coanan 

and Cohen,2002), 

#*^flJ^#;S4VM(Li and Zhou,2015)®att;^*ifWtt^^^^J 

5.3 ||^>] 

5 . 3.1 

ensemble 
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wmm m 

■■■ IfQIXtlfXlYl/AKLIJIYINGVONO 

%■ -^(multi-classifier system 
(committee-based learning) 

[fl 5-3 ^-^^^^-^“^^^^"(individual- 

[^M”W(homogeneous)„ 

^^tl^^“*^-gt^”(baselearner),ffi®M^^»&^*“*^-g»&” 

(baselearning algorithm),, ?$«#lj SB |s] Eft 

^&J(Wfl#&ra&.£#WllJ®*“#JSrto(homogeneous). 



® 5-3 t 

gftM. Wf§3*^ »"( weaklearner>;£*$M, B jlfcH 1*^9 W«#«Sife 

tfctS!® #. 

3f . SBMfi 
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$ 5 

^HW66.6%M^)t.®«^^iPii5lJT100%;^|f|5-4(b)4 5 ,H^^^ 

a«»J.SI/ft^ttl6ift^rllll5»ftffl 5-4(c)+ 

33.3i$0g»gMw. a^w^M^s^ai^^jfWiija, 

diversity). BP^$H:&£Ii#. 



S'] 

■& 

#J 1 

S'] 

•& 

« 2 

S'] 

iK 

{ #'J 3 

S'] 

iK 

w i 

S'] 

i£. 

W 2 

S'] 

m 3 


S'] 

iK 

4H 1 

S'] 

m 2 

S'] 

•$, 

« 3 

hi 

V 

7 

X 

hi 7 

7 

X 

h, 

7 

X 

X 

h 2 

X 

V 

7 

h 2 7 

7 

X 

h 2 

X 

7 

X 

h 3 

7 

X 

7 

h 3 7 

7 

X 

h 3 

X 

X 

7' 

& 

& 

V 

7' 

7 

7 

7 

X 


X 

X 

X 


(a)£/£UW£& 


(c)£&fe.£fM 


® 5-4 *jMH^A 4, *J-i«»*W”(hi i *£>«) 

P(h,(x)#/(x))=e (5-9) 

iE$i, K | JllJ$;3)‘^ifcIE$i : 

H(x) =sigw( Sh,(x)) (5-10) 

i = l 

fliaS^SSW^WffiSSIli.Jild* Hoeffding^^dT^,*^^^ 

P(H(x)^/(x))=(S(t r )(l-e)*e r_K )<ex/>(-l/2T(l-2e)2) 

4=0 

(5-11) 
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■■■ HOIVLIVIVI, ANl Ul VIM.N(‘\<5 

\tirm 

I'Bl, Oj [5] 0+MMBoosting, ^# 
Bagging ftI“PiH ; /L^|#”(Random Forest), 

5 . 3.2 Bagging-^ e®. #<.^.4* 

* 5.3. i 

1. Bagging 

Baggi ng ( Breiman , 1996 ) Jl ft ^ it W 45 W ft iS» it 45 ^ BP 

Bootstrap Sampling). bnMi'&'fr rn 
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% 5 

i***:® Bagging w**. 

Mo Bagging 

S^434#o Bagging 5-5 

: M 1 %. %. D= {(xi,yi), (x 2 ,y 2 ), •••. (x m ,y m )}; 

% $->£■ e; 

nm.MT ; 

it#: 

( 

l : fort=l,2,”*,Tdo 

2 : ht=e(D,Dbs) 

3;endfor 

tlltfa : H(x)=argmax2i I =i IT(h,(x) = y) 

scy 

S3 5-5 Bagging 

oam),wi Bagging «*&**&* no 

Bagging 

Bagging £ 

AdaBoost Bagging 

w&Mtomfr* . 

Bagging 

63.2%^#^.fjT^ 36. 

f^^iiE^5fc^ i tSik't4|ijS : f : f“'S 1 ^h / fi!jii'”(()ut of Bag estimate)(Breiman, 1996; 
Wolpertand Macready, 1999) 0 

Dt ht HoobummM^ x AWhBi 

■«, x x ±m»»j .# 

Hoob(x)=argma x 2 ,Li II Ui,(x')=y) • II (x • Dr), ( 5 - 12 ) 
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■■■■ JIQlM/'EXIYlUNl 1JIVJNOYONG 

J3U Bagging 

6 oob.= -j J t 2 ITCHoofeCj)^^ (5-13) 

| U | (i.j)ED 

Bagging Hilt 

2,#um* 

BSf/ll!£#(Random Forest,RFHBreiman,2001)J^ Bagging fft—'t'JTM(S) 
ft. RF Bagging Mhmmt\±. 

m\ r i \nm ■. k =1, m m&m w »*&*■*?#&&*» ts m ; 

^-/fe-i.wjiiatiiji^-^jRttffiyfti^i-iatffaT.Jt^/k-iogtrf 

(Breiman,2001) „ i 

&ft*f Bagging KttT/J'Sfeffr.fiA-5 Bagging 

# (ii&xttu *&-uu > ffn * * m • 4 > » 3 m w £#tfe* 

M ,2* £ Sttttsfr, wgflstttl nTiiKt'hfr 

Bagging fflfcl. 
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Bagging,Bagging 

5.4 

5.4.1 M.*.m.-%: 

., m«j. n m^mmmnuFi- 

imkranzetal,2012). , ‘MW'J^>l”(rulelearning)^RiJI|^^rlg^'^^&—M 

!w»j mmh= 

—/1A/1A— A/i (5-14) 

*’*32lS|5^*“ajiliJfr”(body),^«^*PJWItr 

^( literal) /fe IS W 1q IX 5^ (conjunction) 

ij3tr^“+? 

^#Wig^«PJ«^^“if-then MPJ”o 

mwmm± , ram# mt*» s-#® . susi 

TOfl!Jl!i^“^U,r)e5£*(X,Z)A^*(Z,y)",HJlfc.aJl!l^^ttEa 

&jfi£P3&g+3iA«#*niR. 
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■■■ noixuexiyl an» iiivin(,yoni; 

R-. 

^SLW'J l:»^(«#=*|l||)A(|JFW=iaBS)» 

*IPJ (M=fI^)o 

MPJ l W^ffi^2,'eiiill i l*rW > h2»S:^W!Rtt(valuation)*xtw0!l 

mnmi, 2.0 D**»aa 

PJ“MM”(cover) 0 1 1 m 

iWMW/HiRtii m 2 

“ ^ ^ ” ( conflict)*$$?& i^t 1 1$ A/ “ ;£E ff| ’’ (conflict re solution) „ 

* HU I&MPJ; *0$ MMPJ^ as** “# l?M ” (ordered 
rule)^fc^lR“{lt^aaWJ”(priority rule)^. 7G$Jtl&&tt«$itt*niR*& 
i^-^“7cMPJ”(meta-mle),gp^T^PJW«PJ.^J^“^4?4'^B : t^ffl^ 

-£‘‘mMMl}”(default R 

1,2 llWWItfl”. 

m i* f& ± m W , % PJ nT # * M m: “ fa m U PJ” (prepositional- 
rule)fP“—|5^MPJ”(first —order rule)„ itu'^JikFtr'I^^^pS’Apropositionala- 

tornmm.m&&W J 5”( a ) V“j?T( V) ,“^”(?)?q“ll#”(-)^^Wfti^« 
*0; #MPJ£§5M;l:-^ifr®M«, “« = *»” “0F» = W 

mula),^J^^^5C^^^MiIiW](predicate)“^^(X,y)”ic)i^^^,#in 
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% 5 

1 »£g&tt”«fenrefF‘vx3Y(g. 
&»(Y)—g$»<x) A((y= ( ;(X)))”,^Mf^^W‘ , vx(gM^( ( T(X))*-g 
^^(X)” a x m y v”“ 3 ” 

ST *H“#£”, ffl ^ M MM ffl. fa *“ M” ( quantifi¬ 

er) . 
alrule). 

mpj i:»^(x)-^i8^(x.4i^) Affifwcx.iaB), 

MPJ 2 ! - 7 tt(X)^l(X.|g«|). 

S&, AUBsS® m «*#, ifrMPJ fiF-BHIM M#® - 0 tffc- tit 

5.4.2 JfrJTfltJS. 

f»SbBk“J*IIM”<sequential covering), ,&ill|S3fc±«#f!|-& 

*±i££t@. *T^?^R^Jl-g|5^1g,Hlti:tilM^^“^^”(separate- 
and~ conquer) 

wmm\, 

% s#+? 

“R (Jitt i, Jitt® V) ”+Jitt * i , Mttm 

ij&mM&i WSSi «r% 
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■■■ J(C'I XUtXJ Vt: AM IJfVlNCtVOMG 

“&#=iW’jraAMA!M#?J 

&#&Afl«ll#fl K6J0 fa i7,&4 , ^m^jEflfnra^&fl,*ft£‘‘^ 

flirts# =mm” 

M~- (&»=##> a (##=##) 

«»A!HJ5M7£fl 17. 

ifflt— (fe&=W£> A(tR#=fli6) 

& %m\ r-wmmm\ ,fijRtft*i-tiHfl. fi b m £‘'MM <x 
tm 9 'ttemmmmM, tsmtmm^mmi ■. 

WJ l:M«-(^=W^) A (##=#£>» 

&PJ (&»=#£) A(»^=ifeBfl) ; 

M 3 : *f/EA-(&#=4ll) A(tS#=«iai); 
mu 4:M-(fe#=4m) a csta=fg«i). 

down), BPiA mm ff 4& jiiiiisji vm'hmi wmm n , » 

i “£ &-# S«” c generate- then- test) ?£, JiMM'J il 

* ^T“#fb”(specialization) 6^£i® 0 H^fl 1 /S fn]_h”( bottom— up), EP 

m. tk«« wa aw & -wn b***? wr *flAy« sue a • jcsua jb## % 
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$ 5 vnm 


it.; $>■§K^j”(data— driven) ££, “Sft”( generalization) fjfj. 

f$fflf££ 0 

TffiWjSMflgll 2.0Tli|^*fiaj*^gi5i(fiiTWa«iJ^J®^rj£. f 

#&. ffM /eJ£ t ij 11 m m m m m * if f s« pi «j m ft % ,n/ m ^miiaA^^mrnrn 

m %mmm& in® 
5-6 mm . , -&#*=^irurra =m m ”fPi*nj tm Mmm 

^ 3/4„ 


$T7H — 


$-&#£&# 

fi»=fr^ (2/4) 
feft=4Jj& (34) A 
fRIMMi (3/5) 


m-jg=*sa& (2/2) 

®A=?Jira (VI) 

(Vi) 

®roP=F]Ka (2/2) 


*/£=&; oft (4/5) 

&JMW?r (4£) 
®ifW=rafiS (a*j) 


L- MANS* (2/2) 

witetM^^aiiij: 


ftUKMKflt (3/5) 6T/C. — (fe^=4H) A («*M*lt) 


ffl 5-6 &&&&#& 2.0 W**.*." tiit4ii’F”&.& i ±&*L*l 
« mf M M £#= A ®”*D A£ a WJ Am 

M*-(fe^=4H) 

am . mmmi mm 

M Mi»t> t if f£MJ ft £ fttiiJg, SE± W&fJ W ?'t f$ffi W ft 
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JIQI ■<€» L XI V< ASLi'iv INGYONG 


^"(bearnsearcM.BP^iftfiiSftttWA^S^^.ftT-lfe^fflTttlftljliS 

m 5-7 *%%mb=2 mm 

8&Tffi&&«Jliy ,£***{&* 100%,{IMMT 3-tJH^'J: 

M^(J8FSP=[Hpg) A(*gH=4t*t) 

5.4.3 

o mn CN2 »&( Clark and Nible- 

^^Tit».cN2 (Likeli¬ 

hood Ratio Statistics,LRS) 0 4 , '« + 


S ,m + .PJW 


A 

m + 


A 

»t_ 


LRS=2 • (tn+log 2 


„•) 

m++m- , A ,_tn+ +m 


(- 


/« + 


) 


+w - log 2 


(- 


»2 _ 


-) 


(5-15) 


-) 


m++wt-' 'm+ +m. 
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W> 5 $/ms 

w^sd : lrs (* >aff ® «*£,« 

&« wn8'j@*; lrs ®/h. im mm (*) nTMjmi 

. $®J#u LRsm±(« o. 99 ) 

N- CN2 IM±III(*)4^ 0 

^if^ft^fflWmm&^“^l§^fe”(Reduced Error Pruning, REP) (Brun- 
kand Pa ZZa ni,1991),^*^Mfe^:^##J*^l^1Jll^^MII,i^ill|^ 

n nTIgMUf KM - 

In t. 

REP Mfeilliftfl^r^CCBrunkandPazzani, 1991), {§JH 0(w4) ,w 
§ o IREP(Incremental REP) (Fiirnkranzand Widmer, 1994)$f 
g&SPHSlJ 0(mlog 2 

REPMS,#flJMJr , ;^r'g^M#^*^,*Mirl5W#^J*±mg±^ 
as. fi^.REPstf^jftwjiatifirtt.M irep, s 

RIPPERCCohen, 1995)^^1, 

RIPPER 1 5-7 IREP*imffl$fl£J&MJi!'J* 

A A 

R, IREP * (Cohen, 1995) Ji IREPffj&ia, ± m&U m+ + ( ™~ V ftT 

m+ i ??2— 

iREPflwaw*«iw*aiidtti6«**#.*»ttwiii^ajidra»^i 

irep #&. ripper 
m r *Mn&gynj h,ripper % 

*6j te £W > MEtt o 
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BHI IIOfXlIJ'MY U AN LI UV(MGYt)N<5 

njf ri IIMJ IREP * 
i&MPl'J (replacement rule)„. 

ri":M ri IREP * n 

MPIO iTMJS'J(revised rule) „ 

termin 'r m 

% w-x ripper jih r 

, u%m m u m w m piy in u %-m . 

ripper mfaimmm r 

tt.^MttaffiaPJMiSFWSfclKFiimkranzetal^O^).- 
4fr A : 4;i| #.#£■] £D ; 

*a.*.*k, 

aiJMMfcT; 

i±«: 

1 : R=IREP * (D) ; 

2 : i=0; 

__ 1 

3: repeat 

4 : R'=PostOpt(R) 

5 : D^NotCoverecKR’ ,D) 

6 : Ri=IREP* (Di); 

7 : R=R'URi 
8:i=i+l 
9: untili=k 

4fr*i*.JW* R 

a 5-7 RIPPER#^ 
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$ 5 nm 


5 . 4.4 

«t!M^Ji“##±JJC^^”(symbolism learning) 

(Michalski, 1983) D (Fiirnkranzetal,, 2012) 

^5.Michalski, 1969)W AQ 

,41, AQ — AQ15 (Michalskietal, 

1986) < AQ17— HCI( Wnekand Michalski, 1994) 

AQ^&m^tJgo PRlSM(Cenclrowska,1987)^.^ : Tii^M > 6]®,i^i; 

' S m fa , #S^ Hi tk 

s.m prism &mtMn AQ.siita^ 

CN2(Clarkand Niblett, 1989)M*3>®'lt, 

». RIPPER[Cohen,1995]^MPHJ^g^^Mii5il'|,'Si!i!^TM^Wi4 : 
KCigf RIPPER 

Winston(1970) iE ilT^MPllJ^>l^)t^ 
i&itmi %, -i^«jfoil 

2010 

)t^ : PF®M“^C$!lin'W^ :; 9”(Never—Ending Language Learning,NELL)ific'J 
BP#fflF()IL^gg^©W4 I Mi§^^(Carl S onetal,2010) o 

MuggletonC 1991) ^ & J “ *fi £ ft@I? i£it'” (1LP) &■^ tR i§, ft GO¬ 
LEM! Muggletonand Feng, 1990) — |5fril!$i|^ 

>wmm,#m±T fa±is*fl i& ilp mm .. */hH*£fls (lgg) * 

(Plotkin,1970)HHi. GOLEM MHfcflJT RLGG„ PROGOLCMuggleton, 1995) 
^i£!0^t&i2:^j2iM#(inverseentailrnent)# : I$t#TjE£p$ti?=o Hriflfa^PIiTf 
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■■■I JlQIXt'FXl VI AMJDYINOYONG 

SHr&JKMuggletonand Lin,2013) „ &X ILP 

s&tt Prolog Prolog 

progolcM U gg ie- 

ton,1995)#fl ALEPHCSrinivasan, 1999)J|J!iy^jr'i2fHJ ILP A® iti 

ILP Datalog(CerietaI,1989)Jl!|Xj»lB^«« 

j*&t®±&h SQL 1999 ibmdb2 0 ilp jmwMin 

$5^ Muggleton(1992) ,Lavracand Dzeroski( 1993) 

»gi?ati-#iSL(iLP). iLP*^is®iai,fift4«i»igftiiflii^»irAha 

—®JS£?fr(Bratkoand Muggleton, 1995) 

(probabilisticILPHDeRaedtetal, 200), ^ IK Bt$TF*] 4 1 fK)^> IK^f* j£ W 
“^miH-»fW”(rel a tional Bayesian network)(Jaeger,2002)^„ 

itJi»+MS^^^,KflkS^^^iSWM¥^^^S(Rriedmanetal,1999), 
M Bf^rili^il^lJ^ (Bayesian Logic Program) (Kerstingetal, 2000), Bj nj A i?? 
H:p«l(Markovlogic network)(Richardsonand Domingos,2006)^, 
^^^A/”(statisticalrelational 1 earning)(Getoor and Taskar,2007) „ 

5.5 

5.5.1 ^J&’&SVM 

*DJX20#iB90^^Efe Vapnik 

Semi -Supervised Support Vector Machine, S3 VM) J! 
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% 5 

«ilja^l'0l^*J^W®,lfff^#^»iH#«,S3VMaffl^i!j»M|l| 

SAfitijtJV* {&?£{§: 5hPS”( low-densityseparation), MM> 

Ajmcffi-miAftistomr. 

S3VM 



• • 


SVM 

(“+»“_ sL')?Lfa\, 

® $JH TSVMCTransductive Support Vector- 

Machine) (Joachims, 1999) „ SVM—TSVM-tilJ!kftX'j'^;5)'^§|b]i§ 

w^ara. tsvm nTfiBW^iss* 

(labelassignment ), ® A iE # ^ 5J" IE #J git S. ^J, M /S tS 

5.5.2 

5 - 9 fg& 0 

#3fc^s&nft^.BP»A$iu x 
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#163*5] MMffl 





m 5-9 

«(Kemel)3r->h®»« • ) W J-.z eX.Jij£^(5- 

k(x,z) = <<p(x) ,<p(z) > (5-16) 

3/ftcAMffifelt <p :X 6 R"—9>(.r) 6 Fc=F", g + 

ffliSM Mercer 

Fisher 

PCA. 

5.5.3 SVM 

svM^a^m*/h4kBP srm nuw^rwftJSBt-diftgftiiw# 

m immi , g 6**s^#Ht®*Tsr*Tto»—ji&tt-g 

SVMiA^. 

tt!T4M#«TW*tt^iijfe®M*.S^Si[nrfflBa 5-10 MlitMiftW. 

. + #1 h 2 ft 
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% 5 #/#i 

|HjPi (margin), Mil*ftMM W *, X njffi5>^. 
H, *P H, Lagrange 



a 5-10 SVM 

5.5.4 SVM 

5-9 mm® 

svm 0UtSf«^. 

SSVMt.fWgaH • • ),}E 

XB*ttflJ^-^|BTF,^-tS|0lF nrK*WR«SfiI. 
mvmxmm^Mo Hubert$(u,tfe#«ME$ra.’ mn 

Hilbert $(BI,#^iaS#^RIWrt 

*. w. mttmfc lujs , al bp m & n rt *rm m®», 

jammsvm mmm, 

Mercer j£S„ 

Sigmoid $£tiU&'MMi.l*t‘^<. 

2 . 
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■■I JtOlXUEXlYUANL IJIV1NUYON0 

P$ . MM 3 t^ nj IU,flS *fflM#fi§£I'H] #m m M 

Wifr. 

Sts# is it ^ 

r(e) =max(0, | e | —e) ,e>0 (5-17) 

. s hu , e - %m&±wmm'i± 

5fe a * a» . Huber g m . 

4. ill|ftJt& 

Quadratic Programming,QP) 

SMO Mm&Jfrtim&M EG Xit 
&te&$£M3ffintisM IDA £*KM£*+ SVM M$ 

m% . 

5.6 *^SVMWSKfcSi3] 

5.6.1 M.-3^ SVM Q 

mx SVM i$&^$|0] Q Q & 

%vm% svm w0iaffiTt-(5]«,3pjffi svm 
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% 5 JJjj& 

5PHI 5-11 ffiTjk, 



S 5-11 *tt. 

»PJ*rW»A-Hm»|g. SVM 

SVM Wit 

fK. * t mem m, ^M«ia!i6«*«isiftw 3if 

$MA#Ailt:fiuMit Karush Kuhn Tucker(KKT)&ft=*|#r. iSrif » 

ig^jis kkt svM«a^«najEfliMia^»ig.^# 
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■■I jII.HXUEXIYIAM IJIVIMiYONG 

affyilSS«MHff.B^|BI®ft«F^,^&,!il!lJ8EWM SVMmeiMtl 

TSttutm 

1 D = {(x,.Q,) |i=«—/,/—/ + l,•■•,?-!},^r|n#^|iA 

M X,-, = U-, .a,-! ) T € R"" 1 t -1 B} £lj n 1 =(S1 (t -1), 

j 2 (t-l),-,j„a-l) T eR” +1 » 1 *Ss&ffc«,-i 

Boltzmann - Gibbs 

5.6.2 as SVM 

/ K(BIrtW#+.J®^«ig«S3S#^S!l 

^ttit^AAAB.tiH] ® , liAsift k (bj rt #* w* 



2 (£—/+/ + !) 
/(/ + 1) 


/-I 

, £ ?, =1 


(5-18) 


c(x,Q,/(x)) = | Q — /(x) | e =max{0, | Q — /(x) | — e} (5-19) 

infS 5-n 

Q = /(x) =c« t 9 (x) +6 (5-20) 

5$+,«> Mssfafi,* *mji , %& a , m b , 

e'*’ = (e,-, .e,-V> - *£(-1 »£<—i ) r » jEMffcfcft C, WB| e" 


min # a i i9 i i i m 

co 6R n+1 ,e ( *^ 6R 2/ ,6 6R F o ( "*f >=i“ +c f = ?_/«.■+*( > (5-21) 
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w, 5 


tt A£f ® 4 1 3IA t Pit (5-22) ffii£ ftg ft *& ® Sfc*f& ft m t#fiE$ I ® W 1*1 IR 

m, 

k(x, ,Xj) =<p(xi) • cp(Xj ) =exp( - U J j} )» 

>.=J-/,i-/-F,-,7-l (5-22) 

5$ (5'- 21 ) * ft IE PJ c (5'- 22 ) t M <7» nr M M ##, 

31 A Lagrange a' ” = (a,-/ .a,'-, * "’a,-! *aAi ) ' . fljffl Lagrange 

fe«jSJRteR«wxtffl(5ia#^*T^affcftisiiiBP vmmmytm a ( -\ 

s.t. 2 (a,* — a,) = 0 

i=t-i y 


O^or,- iO/" ^=y~ 


(5-23) 


BM0J^:^^f5]«(5-21)^Tc O 6^P®-^.PTffl)(min1«(5-23)M» 

5f£^*K-E[] 

<w* 2 («; -a/)©(?(ii) (5-24) 

i=t—l T 

f(x)= 2 a>,K (\\hbarjXi ,x) +b (5-25) 

i=t—l 

^4* <it)i = a," — a, o 

^(a l * , )MW« i fHa«* 


T: 

a!*’ =0=> | Q, —f(xj) | <e 

0 <a! * 1 <C=> I Q, -fUi ) | =e 
a* =0»|a -/U)| (5-26) 

kkt ft Mm, 

^ MTOttft.BP 

b=b=Ssv +Q.sv — 2 (a,* —a,)KC?,Xi,Xsv) (5-27) 
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■■■i J|Q!XUEX1YUANUJIYINGYONQ 

~f(xsv) Q.sv , ^J^!l^f^lM-rw 6 ^'fe'H''^^o 

5 . 6.3 

4Slg±j£##T,*£tiiST svm ft 
Stepl:toi&ftQ^i 6 ^J»WSSVMIlIJQ«[S!ft«R. 

Ste P 2 : mH MM ^ BU s ,. 

Step3 : ^Jia t MM SVM ft^UU##** D,&mVtik {niff (5-23)f§g| 
SkVtM a‘° , *5£(5-24)#lj£(5-27)ftI!) SVM ft*£$I#$[ a, fflfc. 

Step4:i^(8-25)itJr^iiJ^iS^f^XtJ!3ift Qffi.fcfffc'fcfclfriSiMk:*: 
QttMftS&fta,. 

Step5:iftffi|frf£ a, ,$®.”F—Vn.&3J!lBP®flK r, 0 

ste P 6 s m m q fc&n&mtMm q ft, nm s urn q» 

Step7:|9(»f»f»ig(x,,Ci)®MS KtfT 

Step8«£*fl^#:3£&$&fl 1 ,**-t+l*$$ Step2 0 

5 . 6.4 

^!l«ll^Hiftlf BP 

32ffc&?r30 ®^-ft?45:^Kisft= {frJtiie+.ffTSVMft 
#«C^:y = 0. 95,17 = 0. 15,C = 100;fflT^J^^#m»&ftffi^#^^:ii^H 
T/3=0. 95,®J*±Pg{t T nMll =0. l.fiUTRfll T nun =0. 001,<x&[0. 3,0,5]K 

le^isitfLM 0 . oo5,/=5o,*^ffl» t s = 0 . 02 s; st bp mmQ^nn 

#»*:7=0. 95, 7 = 0 . 15,0=0. 95, T„» = 0. 1, T m „ = 0 . 001, T, = 0 . 02s, |*4& 
5-7-1, Wf&MjBUfciijaWjttSSaR^SiJ* Sigmoid SIfp«ft 

a».w^^*o.2. 2000 am#ft® 

& 30 m^ft^Wiift+.ST bp mtm q 4 Ttu^' 

IIMWiitlMi* 2000 0tfB]T,M*T SVM ft 
■ svm ft q 

m 5-u(a)m 
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W, 5 

tst svm bp mm q ^ 

. wim& svm w q 48 s 

#.M»TBP W^WQ^jggEUdlffftil 1041 iJc^^jgTl'HrWJMFSffTir 
2000 Hrf». IS 5-12(c)fq® 5-12(d)^ftTM#Q^^®«M^ii 
48#; in 1041 

SVM ftj Q ^ 



saifcik get#:* 


( a ) ST SVM ft o fla ( b ) ST BP W&ISS Q && 



( c ) 'J'Sftg ( d ) gffSS 

S 5-12 

*1?Mft T-#ST svm N 

H'hfrffi. 

(l)SVM Q 
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tUB^SUSSMJIJ 

■■■ J101 XU F.X I VI, AN l .1 ) IVINClYGNG 

(2)ST^^|0]«MW SVM SVM * 

tgttMffiitlS. 

5.7 

2000^,Seung^M>hajjS»W)l*lfe45nnU*il''l:$ifflJ«Ma» 

% fflf i£, in IS W ^ it fp A M 3r fa. a It ft T # £2 % If it i§ ^ ft Ji ft ft- fa £ W fft 

*{£*£&0rM. igltk,Seung %ik%®fa m w&Ij&MIe, i*3/ST»fa 

(ISOMAP), M«tt&A(LLEKft#ft#r#tiE 
8*lt(LE)fn Hessian M^ffetfr A (Hessian LLE)„ 

#mtfW GRAM 

^>f fait :**&{&#£-* fa i+g fa IS) @. §q #|E fa M. M JSft 

\ 

5.7.1 

1SMI- Hausdorff^thSIU.^M W#—jS/» 
liU fp« t’fa-^fF^MJ&fa.PJffcMJt-^H 

2 . 

fa faffH, MUcCl/.p) 3/» M fa-'N^f?. 

»n*ei$ x„xoFt n 't-Dtm&m Mx, 
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$ 5 

d(d<D,-mmud<D) 0 
mmx ^mMmmmmmd a 

. ik%d &z, 

i(A6<)»owwix mtt'&mM-n 

5 . 7.2 

m Xa place WUVk%i .M Air £ M 7f & W ffi m M ; % A Am M mA M IfP 

n»iMWJFk.M Hessian n^^AM^m^mm , ® 

5-13 



a 5-13 


5 . 7.3 

p$, mmw 

tfli£4|5«AXaplace WffMM ,«ffclt>*±^JS7f^#W|}„ 
1. ISOMAP) 

isomap a 
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■■H HQl.XUEX fYl'ANLl Jl V JNGYONG 

isomap ir*fe->Mt«^:w4feiejiie#ha^tt^. ^n*ia4Pffl g &j& 

ig4p@>t'^p(Ri^iip^ttw*j£^^o jifc^, isomap nm&ss&gM •«# 

lRl«TOfflWS?HW ISOMAP » 

ISOMAP JFftWWiWtt 

2. ^»I4^A(LLE) 

LLE LEE ft 

LLE * >fi« x, &w # x s x, 

RHfiW«EJ&iW^aiH4SS. Sjtfc,LLEji^TM^^^ifi«WM^ffi±, 

) 

y, m^.^m^mm^y,^m^mmm 

Y */MfcT® 0 «es%: 

<pCY)='Z{y i -'ta, ii y ij ) 2 (5-28)’ 

> = 1 

^(5-28)M^J 

<p(Y)=(Y-WY) 2 =Y T U-W) T U-W'>Y (5-29) 
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$ 5 

cr-wra-woiftit/h d MJ^nX' 
n W$^P$.LLE 

■m LLElilftftX£,£ir 1 '^ 
jgifoiM. lle 

3. Laplace #W|J(LE) 

GWfttftMx,- ^x } 

mm^nm.Mwm'fc w,mm^* yi mm$L 

<p(Y) =2(3/, —yj) 2 (t)ij (5-30) 

»•; 

ft 5x, £|I]&<jlE&. m 

lit, mm* y , ^yj 

Lap\ad a n&&Lmfn&mmmM'Hk 

M7tnmmwmTtmzft,® L*p\ad a n&ftL&$:L=M-w\+n,m 
^(5-30)$A 

cp(Y) =X(,y, —y, ) 2 cuij =2Y T LY (5-31) 

*•> 

Hnt,*/j^ f (Y)ftfi ^bit Y T LY,immmm* y niiari# 

Lv=\Mu . (5-32) 

(DLEEJA, VERLCYSEN M. Nonlinear dimensionality reduction of data manifolds with es¬ 
sential loops[J], Neuro computing, 2005,67 : 29—53. 
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■■■ HQI.XIJEXIYI ANUMVr.'C.VOsf, 

4. MM(DM) 

dm m ±.%x r 

^(Markov)lttK. 

#£nriillJK*tfl3|6,ii#a:*jfirftttS^* Diffusion JEft. 

+ .SfeNW Diffusion 

fctW.fcPJffiftW = {««)* 

<u# =e^ (5-33) 

^PJWSrMfcfc* P (1> . 


D( 1) — Wij 

2a> «* 
k 


(5-34) 


mrisjW^I^^^ J i/(P (1> )'.J®ffll5St/l^^6<Jmf|fi]M^ P‘”-Diffusion 


( *(rt_*((> \2 

D w (x„x f ) =S- ( - ^ 5 - ) - ? ^ r > - 

* C0' U) (JT* ) 


(5-35) ■ 




9 ?(V) =S(y,- —yj) 2 w,j =2 Y r LY = 'Z(y 2 +y) ~2y,yj)u>„ 

*•> *»i 

= £;y?m„ +2yjmji ^Sy.y.co, =2Y r MY ~2Y T WY=2Y r LY 

i jj i’j 

&*i *s(5-35)Rrw3tai*^rswfriJi]^ft’ 

j 

«45to#«tfi£ttW Diffusion FE^. it®# Diffusion 
k y t-DM Diffusion 
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W, 5 


Y: 

P U) Y=\Y (5-36) 

^i^inT: 

y={Am (.As vs»‘"fArf+i Vd+ 1 } (5-37) 

5. ffitfL4P#ttcA<SNE) 




< 


A> = 


exp( — ) 

Sexp( — d\ ) 

k^i 


(5-38) 


=£i 27^' ff ' *&3MR®. 


9« = 


exp( — y,- —;y,- 2 ) 
Sexp( —y, — ^t 2 ) 

k^i 


(5-39) 


&&-5$(5-38),(5-39)fiJM KuU-Uibler 


C = SEp, y log ^=EKL(p ( | Q,) (5-40) 

i i Qij i 


y =arfftninC 

y 

iia»«T#ftiS^*^(5-40)Wffcft(5|HW,-^jS#lni&j^#«A 
6. ftAM^JF(MVU) 

MVUX#*^jEJE«UM(SDE),KSilJi««pM»iS«*S[|SjSraWffiW 

maxSjy, —yf 
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■■I IIQIXI'l VIYUAKi UIYIMOYOMO 

5. t. = 0 , 3 // —y/ =D y 

i 

= l,^ll’&ig.£.r, &m&yj 

j£«^ 0 

ik^ 

kij =yt • yj (5-42) 

PHJ^( 5 - 41 )^ttM^iHStt^f 5 ]®.SP 

ma xTra(K) 
s. t. ( 1 )K^ 0 ; 

(2 )EK* =0 

(3)K* — 2Ky +K yi =D u? y =1 (5-42) 

(DitWSIfiJ K . 

(3 )it ir^i^ , . 

2500,iiife«*tflR«|T«^rftWiaEffl. W&,£ n ^ffclg 
m ^^®£^f/jUcL&( Landmarks) (—-Jig mKn) 

m ; * js , 11 a ^ (5-43) it jr m ^ ir 

S&fc: 

K^QLQ 7 (5-42) 

jim xm «x™ 

7. $fc#fiElft|*(CE) 

CEJIEfeMW^ttttAfP Laplace 
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W> 5 

Laplace CE 

. i54P£ flU WE* nmS ^ Jttft; $ “, CE Jfft 
Laplace X ftflj m *f 

»*Z,^J&WE « £»«Z ®fflft$»ifil![MI![I^. 

fgi 3 Mx, WW^M/S^x, yi.yj. 



Tffi£tb 

D,(.Sj ) = Hr),,rj j! (yj ~y * 2 —5,x, —x* 2 ) 2 (5-44) 

»+,7v =1 ^x y 0,5, *0f. 

SP&.'£»M*ffifclS»3r 

D(5)=ED,(s.) (5-45) 

i 

R m *S»|g Z 

.y, =Lz,(i = l,2,•••,«) (5-46) 

£*,L€R” x "Ji-^r^tt£ft£P£. 

JE*/J'4k^(5-45)Wttm@^fl:*#jHSaflsl51«: 

minf 

5. t.P> 0 
trace(P) ^1 

rj spi 

>0 (5-47) 

,(SP) T f 

gTL P=L T L, P=oec(p), P$f'ffc*|p]*P.J fH S X w 2 ftj 

ili±S:(5-47)W i f t IEStt<fc|51fi^«l»SlffiSP.M.lBfnr»IIJ^tt$ft® 
ffL=P ,/2 „ ft/5,{K^^fH]M^^(5-46)it^#flJ 0 
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HOiXl'fXlYUAKLIJlYlMaYOxtj 


5.8 

5.8.1 

1 

tt G S-«S«^.#!lfijBlT^#: 

(1)G*->M&, 

(3)#WSJFJipr«W,BP*GXGi!lG W8fclt(gi,ft)— 
finite 51 l J#GJi-'t^S¥(Liegroup) 0 

m o bkimMi&9tm,&m*-'ft#ifc9LJ& .e > ftfirgffiffl , 

£&2 ($«mgi¥3) 

—j&ffl G ^^$£rA£|aJ ,Mo 


©$/U£ , f 6 f 45 #, ism. turn#* .2010,33(7) : 1115 -1126. 
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$ 5 

4- G£i? D ,M^R“ ,D>d *f M 

It (p : 

(p ; Cj X M-*M 

m&: 

( 1 ) X^f^i 6 M,j)(w) =x; 

( 2 ) 3 Jif ; fJglf^rWg,AeG 3 fp J : 6 M, f »(«, 9 TfcVx))- 9 (^A,x). 
ip(e,x) =x fH <Jj(<p(x,g) ,h ) =<p(x,gh) •tp : GXM-*M c , 

7 £X 

Hr cp MttG |£M x 6M,HO X «3ii*£jSC.inT: 

Or6(x) = { (p s (x) | g GG} CM 

def 

(mxtmm&G, -<geG| 9 >,(x)=x}CG&a^#E.G£-'Ms : Pi¥. Orb 

(x)MWTLfl2£nf^Ftll?.t<©lt[g] 6G/Gr-*-g • x€Or6(x)^jt!['5}-|s]Kifn^JX.i & 

lfcnm*IJ£ G/G., Ji-'HfctftWo 

3 £ 5 c 4 (^fflw^rattsW*i 4 »i*itwffiA) 

g6G,lt># g • x => 0 

—xtJSO - 95 R g =e, sp g-*- 

^>R JH—‘^t—' 6 to 

^RW=xltfg=«Jf 
ItWJMfi-'fxeM, P ,={e},#ii-'xt—ft. 
m 1 Gft^^ftg 

T :is Ad/ :g" -*-g‘ H Adg Gt^t® , < fsL$C!h<Ad' K a ,e> = <a,Ac/ge>, j&JL a 
eg* ,e6g,H!li(g,o)-*AdZ-ja^^lt: 

y* :GXg*^*JiG4g*±^#|5iM, MMGt^±65Mi 
^iB^Ad* : G-*GL(g‘ ,g* ),A£/;-i=(T,(«*°L*- 1 ))* . 

SA5(ttiteHW^) 

M/G BPUtfrttitgfB]. 
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■M JlOIMjJNIVLANlUIVINtjYONO 

7ZSC 

u m m n ,g ? R : m-m & 

JiSWW.in Mf0fW«igeG,t /> R =0 R °/,$nm m/g ft n/g ffitJE®. 

fc:M/N-*N/G 0 

*:fG G MSsftft* , ##*P6-«J 

G 5-14 JinT£&fft 0 


/ice 



a 5-14 

m%tii£\B\,G&GUV'>Mm : ?ffi’1a\%:^(gU),g<iy))=<ix,y),Vx,yeV, 

^ 6 G,PJy trtSG.«GT^ 6 il. 

#£** 1 + Weylft# 

lc/(gWg=Al,/(«)lQ(G| 2 ^ ( 5 - 48 ) 

I ail 

K4*.Ul^« +7nftW > MR,.3 <=ex P H(He/i)0^,Q(t)nrw^^ 

Q(e H ) = Esign(<x)e ir,< '’ l,)-H) ( 5 - 49 )' 

adraj 

S=y E a' ( 5 - 50 ) 

^ «6 A + CGI 
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5.8.3 

left , Rtf i^g^^»Mti 

sy^/LM^sy.. 

1. *P^IWI 

»^S¥ G .fijffl G * WCTM&i&l* K, :J? XG-G: (t,g)^g • 0(f) , temm 
&G±M-+a. IM&f¥, I^#nm£¥&£ft. £M{«3^3¥}fn 

Wft»«tS!^*ffl 5-15 flfjSWJBst: 

R-G]—{ x R—R) 

IR# *# i*# 

g — (£>P$|nl*^Al 

@5-15 *#*L*£9«-ft**£ 

2. 

«iiWll^.ii#lltnrw*ja#lll't , W^/Sl±9l- > hRIft^(G)^MT^ 

*IJ«T- > MIMt£ra. 
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■■ jiOj*uexm Mi \uiviMOYONG 

4- t,g 

. iP G g. T.G G a mjj£®,dl a ,dr a ft 

»j*£¥£*. ft a s i'h] &i±k^'& m i't; t l # 

5-16 

i.ftmm'm.d ru 

AM* -( G ) 


& KttsafcMtfl- 1 ) \ / () 

mm* 

m 5-16 *(■&.*$ % ¥in*tom& 

5.8.4 

Mit EMIttllSP, ,15 tl 5ffliU+, fitt# 

^ > AJ&iRSU^rffifcSITfcJ &&m o % TihM£ - 

(2 fflffl |5J @: $n?& f 3 ^. 
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me* i 

6. 1 Wife® 

f§T 1/5 

i 5 ra^«» 700 ^jams 

my*, 

5fZ , aiWft , Mi^l £ Afn M. 

aff]jE£#ft«0r«S. Mtft S?-fnffcfn 1 4 1 M M&tt» 

*^#flfeJ«^.MJ.a^±Waft. ^Ait»«LM#2i«F8PfiWir^^^W 
®t&D^W»M®tIigTMWifr^»^.S^ 

^^P)@ 7 !ja^^p a n^^;^A^aM>JM;WS^Afq?^^. m nEt&BW^r 

®IAN H.WITTEN E F. #^«*£flitt**:ga*<*-»#:tt*Wfegi*-!gtt*> 
[M], m 2 «. dt*:t«IJk*ligtt,2006. 
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wia*. in^SKW 
flrMssftm 
mm’rn 

jt«fnxt»nw*STjip^j5^»je±»ig^awa[«. mK^mtmw 

AM-ffMiSaftiStltftllS. &A£s&»aflfeWfTfc+#a 

^«ttlf^(|ft-^#JL)*a!j||»ig,^»lg+#tB 

Jt£ , ^ffi*e<mRJsj«3iife, &m 

miewtcA ,ttfsit ttft&fg&tt i Mmi ,«#j ,«*&# 

ji ¥, , tm % w , lEffi&Misis 

*ttti-,#«^tfll!L»|gMW»MlEBil 

»|ga*Xf^B$»M,«[|gieiiilWW,^IE*iS^. 

mm a , to«it . 

»«ft#l^iiil^#*^»|g^aw*S[|g**ftfl5llS. 0Mn,***il 

3S#WTfr«±,#PAii^*g(qiHSfcJI-- > hg#«i«tt*^. -'Mr^gP' 

Ktirspwff 
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isi .wirsii^. si%pmm %+, 

stas^n^^t 
mt >■¥ s 5 &w. »«■ mmJ i+s ^ oj50aw, ® ^ * Mm mx 
w,^tij fc ^ai-^si[is,®#*f5SiF±w*ii. 

m\wsmn^ 

6.2 VlW515&&&m 

TtfKMmM&Ato&zmjj uxmmmAx^M, ®%&j%m ! m , s^^ii 

#'6S#fJa*filB»ig^lfftt^Wtl»r«i^:-.^f : S.*iH:MS5iJa3|E«^W 

^ctt. 

5:#ttW*a. 
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m . 



a 6-1 

6 . 2.1 

rrewM . 

?e? tr&,A<n^rwaaiftM&# h &$%■&x&m±m ft mmm«, 
mmmm *. wfs .Ainstnr u 

& w ,& 

4‘^*BciiJ- > h»fWi«rrn]^Bif.ifcnrWfiJfflia > h^S!3tE^J»r3i > h«^JiiE# 

mmmmmvmmmm »**&*«!« w 

«±, # i »^3 , ms ^. i+g 

nim# s&, « & £«« *£fPfem. m*\ m 

' ig ^ MAW^o 
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dna nj* 

7&ifr£Mo 



B 6-2 *##4***8 

fSItlfM.il NASA—JPL 2001 t£9ftl£ Science 

Mfflo NASA—JPL 

4cMMAM£&^£lfc$3SJ®Br. hk S»» 
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■■ JVQlXl'l XTYl' WLIJIY INGVONG 

10 aa*e 7 $^o 

2004 ^ 3 n ,&ns DARPA(ap^Mia®f^it*JM)M 

mm e sm 53 132 212 &m>a<j »e.&&7S^. 

tmmSi m. rt W lU E fti&gl 4* • Mffl ^ ,W Wife AM 

^S*-^^Sl.wri&fc^XW«F3»£tt#jfe2EMAW^tS. 

7tA»g 

Google, Yahoo, 

A - #1 tillfl £ A B £ >1 'If! 7& i H fr ru JI il M % $ A A 7 m M. » M A M W ft A 

mmffimmi'gmi Goo g ie-^7“-^iSif 

lie*mAWA7^jl5^l«l®^ i !I^Mffl^.f0nT^m^AA-77^7/L^'¥: 

MUfro ff£±,:*ifcji Google v Yahoo,aJii[|l:.^S«W»*W^«*ffl 

pa< s a tm ha®«^ ai m , m&mm a a m 

6 . 2.2 

JA 20 title 50 if 

ttu 70 ATMmfflfL & T ‘' mmm ’\ AiniA % p ^% tmm^&mm 
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&-vt?mitmriiZftftw^ a. Neweii ft h. , 

Simon 

. 0*#T^AM^WJt^o Wnx^MtearWft 1952 ftvEWTMZ®. 

38 M%m,£ 1953 

52a. Neweii ft h. si- 

mon 1975 4F®jg.^ 0 ,^ffi.|^ir5Jf2£fo|B!J.!£^i. Afnil$riAiR?iJ, 

xx^m^jo e. a. Feigenbaum >a 

ftfiMnMfi^T.20 tit 

*s 70 w+itw#?.Axi-^iaAr^w’o 

1&'l£Ugmm&T'e.±TlMo E. A. Feigenbaum ft A‘m4X^”£^ft 
1994 ^»J®M^o 

* ^ MM. =?&, , in 

iw a aie«p^^»iR^»! 

£P*± , mR& 1950 ^n * +. wt a &&fij r tn»^ m 

TO.M20 

F. Rosenblatt M 

*P#LR Widrow M Adaline % ft 20 A#PJT 

, ^Jfri IU&® Sifc AM M^i+M ft , ffcft 

ttXftifSW A. L. Samuel MWtSJTlUA N. J. Nilson W“^#l»”#,20 

P. Winston S. Michalski *£A 

3^’\E. B. Hunt #AW“«jfcM*gr% 

1980 ^EA,ftHaArtS^(tA^^ftTH-@t/L#^gWW#;l^ 

¥.«**^#f-^flJi^SE»Sdi=ffl«L#^^«:»1983 Tioga MttM 
J R. S. Michalski J. G. Carbonell ft T. M. Mitchell ±i8W««flSI^^:-#A 

lEtHfc£>.^5 + J[:|IT 20 16 g[X|t,XtSWW«l»^^9f^ 

Xf^jSfTT.&^ft/^ftiTtMAtX.^; 1986 ft,Machine Learning 'frjflj; 1989 
Artificial Intelligence mjK7#L«^3^ft. fJ£T—fcfc«iSRW«F 
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flHHI MQIXI't^iVl'ANl.UlVIKGVOViC; 

£Xffc,grt&^*fii«ft j. G. Carbonell X*§,MIT HjliStt 1990 ^itiJISW 

aw*#.20 M 80 

R. S. Michalski %A*EtfU^# mftMftl&rikto?' M^IS? 

m e. a. 

Feigenbaum ft££ W« AX^fEAW »ft. 0 Ai£, BP 

R. s. 

Michaiski 

+ 20 IttfB 80 

ft 20 tttffl 90 

filfTSi+CInductive Logic Programming) fPi^lSMSlf IS 

itw«» ttffl i 

iP Prolog &-&A£lgXM{iZ-^*AX 

M«W£MM#XftW. MMi£. AXSift 20 tftiB 50 <zim 

so wgfljT“Jiaifi”tt“»«J!ii w .ft“}ta}B”+Afn*Taii*p«SEj^,ji 

igP3^®ng)fili+SAW- 
A^S^WJi,«»iiRiiaoIWA^Hfe^^«^.SJtk.fi 

axm vi . a hmm 

xt«H*fc1R&frtttefnJi5S.SS«TWi>U&ig4^# *$±, til 

* ^#ft 20 #«B 80 WXMmA“»^^PiRX®M^N®W*^”M^fiJ 
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S. H. Muggleton ±te«tf5# 90 fiMMFf. 

. I3S& A X 3 ® TOfl£i&£|B] AA, 

Hilt,ft 20 M 90 

20 M 90 

W&»a«±£#3. Sft±JS^3ft*ft 20 M 50 |ft@gffiT-tt 
H. Simon giftAlglilff^^lliftA«##&&*”, HJlfc 
flJTftAMN®.M. Minsky ft S. Papert ft 1969 ttgR^ 

-f^ft]lt/5i£ 15 ¥WB^f0]HPgAT^'Mo AflJ 1983 ^,J. J. Hopfield ftffl 

tsp (Hia^E»Tj«?i!i,^*ffi»aft±^s*f55jAfnw^. 

1986 *f.D. E. Rumelhart ft J. L. McClelland ±3IT *£!&«#?TMAtS— 
\kwmsm .PDP /hfflWBF*xf^afrTJti^.af(i-nt. # 
SlJJi D. E. Rumelhart,G. E. Hinton ft R. J. Williams M BP # 

. ma bp a#x 

*^±,ep^ft^A,BP^^ 

mmzz-o 

*ife,#ttf±itiI,fg^WliWfI, ft£l$sXg®fll+,Afn 
^w»iiaa5i£ast!a?w##ia*.<a3tfw.*^igBfste#3iEitt,xt]«:MMS 
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® 6-3 

20 m 90 &£#ft 20 

IttSB 60,70 

&Ei£ttTTmm,M1m v. N. VapnikJfLft 1963 T“£#I"J*”M*E 

A. J. Chervonenkis £ 1968 ^MfiiT VC*|,ft 1974 

90 mm# 

A, 90 B. E. Boser,I. 

Guyonffl V. N. Vapnik H ,4j. M KffiSS M-MtilM 90 *£ft*J!>lAft 

Pittasib,Afn« 0*£$$fsjTiti^. *$±,mi 

rbf 

ft ISOMtfLttMjggJg, %W l«I *«l 1 tffl m M & (kernel) ftft» Aff] . 

A&ft, <B£££#*^#*rft*.0!lin Mercer ^JiJift 1909 *££jgW, 

T. Poggioft 

1975 

fIJi. M JtM^ft 'MSi6«£TA A 

. im®\ to&ikmttmi!kfcmhX8mfeT&tii , «r a$tt£” 

«am^o ,mn . s$sit± a 
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ift,I'B] fiJfflMftJ5«ffcffl-'hfcrA<j#flE£m, #fflatWfalUfei* . 

WtW*a*fflftAfl3T*l“A|l5iPM^^*. ».P. Kanerva * 20 Iftfi 80 
SDM(Sparse Distributed Memory \fc A® 

±m*£te , fiM* wwftfta. sdm w x# to.® , a as 

iA3§ 

A g ft W^*AN@= 4 1 

20 M 60 ^ft,#»iW»«J¥l5I1H:.Aff]?Ftt 
70 mmzt 

&}S Mi Wffl M*niR , * rT lit Wtl. 

1989 ^ 8 g .% li asi»Axeiie«^4isuucAi'89)ftiiHft«r^ 

ft,GTE G. Piatetsky —Shapiro $; J. G. CarbonelKW. Frawley,K. 

ParsayeJ. R. Quinlan,M. Siegel,R. Uthurusamy ^AW^t^FT*S^RT— / t" 

internet 

±w«*. 
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Mrft*. *iiifeW«ffl. 0Jlfc, 

m. <BI6?H)l*#|glg||R^ill)tJi«l##^WfBf^Sffll®? 

f^,^ifiil5IA»*W»|g^1*ffn»|gTHa*#^0[JSft#W^^jlfi, 

inH£ 100 20 20 16 

ST«,li|5ADi;nIW^a“^^-M(5:^^=20%.afg® = 80%)”S#- 

w-^ampJo 

at, bj wsg& mm-Y^' t*rw%\iR, mie jim % &m w 


• 252 • 



W> 6 

w - s* &mmMm\}4smmf&&M&m wti# . ^»ig*Jt*ii!i-^es, 

as r. 

Agrawal $AfTSfeXt^Kay»««2tfTWft;£j&, #§lj&A® MW 

R. Agrawal ftl R. Srikant ($ Apriori H 
fcWS J. Han ^A£i<J FP-Growth %&*?, 

6.3 ttfifcffll*® 

tfKSittAsSo 

#M,*R±a##£J*&7-£ftUfl. Kffex^i#«R®f^^x*inw 
1^-# .M-IIIlf^Atlfilfffla, {H Ji'gfn 

6.3.1 Weka 

WekaCWaika to Environment for Knowledge Analysis)yH^X'FFJ®iifIS 
£« j* Jft Java jgfr. ±5 * * $T® ^ W£ (Waikato) A^?F £. 

Weka E^XSAMA^iS(GUI), W 

s-^»«nraibx*MSr^i®r*Afti. w e k a 

ftS^jaSfcWftS^WGUK-flr^fffilP Java IfltffltSSinSCAPDffifflK 
I^KtraS)?. fiJi.WekafflXAM^W^^M^.SA'e^ 
MftMxoi™ ram^ ag^psfjo 64 

xmmj ram m,m w e ka w xmm^wm f* ^'umm^mvxRmm 


®IAN H.WITTEN E F. »#,weka fllS^^S) 

[M], $ 2 «S. JtSC:«l«IikaifRth. 2006 . 
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. * A£ Weka *eWW*®AM»fe4u 

w e k a % 

«gfflWiS$a. MMlKAA.Weka 

J!MJ^#K£lttitJit, £ Weka3. 6 j£^[s] 

m weka 

Weka J§Jf:& AWA*A Java WAMfrf/fJFJ£[Pentaho *11 
MOA(Massive Online Analysis,Iftf 
Java W • Weka 

6.3.2 Java 3° JVM -is-^- 

SfAMJA Scaich femftVry-timmm W-java JtliJ-^Kfttlffi java l£ 
MCJava Virtual Machine, JVM)± Jiff tfj if§JiMtfjMo 

s^r± a t/i m ft-±n m #i n m e 

W4#S'JJi FORTRAN m C ifgRAM *n CPU MU WiflT-AUiM J1 

Java.lBJi Java A A fl<J K A M U tiW K tt hB A il A /$] ,4', If I M *6 A M 6<J M 

■e A ® HI 15 S'J JL -A ^ A 0L if W -- a, Sfc it # £ & A M Jf ft A » & JS ffl- #. 

Apache Hadoop njF^JUtMiAnT ($31A Java ($ . "£;?£ 2008 ^itf5Bf 

#£J£iM£A*n 2009 A'fMlflll. 'S^-AAPKc'tASaMSA Java 
W&Ao 

^A-Aiiffl^ei^W.JavaMUcM^i^F^itfeAMrAitit.JtSa 

Java, H 

AS#^Wig^Rtiax-tAMSJTJiA^^W,MS. JVM 

cpu m\ ■ 

witamsiiST. *5F^ftig«#iMgj?5w«fse^siT,java 
• H : e*f « ,*f»*n 
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(btt Mahout m Weka f£)„ MAXIMA,{S* JVM^S^Wfr^- 

Mo 

Scala fB Clojure KSfSIWW.fcflE## JVM Aii^SfflA ftlg 

«*&#«**. ScaJaJft-^HFjRSW.ifl&iW^*^!^*^®. 

'El## 2003 Java (ft Mo 

Scala Java 

gf^.fE^ar JavaW?Fjft*¥,XJiiinTiS*^@W.MMfe^«MJrafBf 

?Po Scala iti^Jf^;Aw ; l f E®^C^inWfn[Sf[o]X i t|l((X),object — oriented)ift*^ 
g&S&tfilttifc.m J,ava TJMt OO &i+. ilt^iWS 

oo fniiSsSS W* 

iwl oo^gMW-^isiRiMia^T^aHB* 

«is]-Mo mm 

scaia 

Akka ft Spark a#6!l±l?JFMa'. Akka Ji 
JVM Spark MAAgJjP 

AMP$||6S|sm®ll«. Scala |ig#EI£i§ 
•ISOAI®1 (Foursquare) ^AJ$( the Guardian), APip A %. R (Linkedln),No¬ 
vell AM (Siemens) ,^’JB A-^l(Sony),Twitter A^ftilA-W] JHA# 

^JIj^o 

Clojure Eh RichHickey 2007 A£^o -gJi-A® § f& 

* Lis P iag^ww$#.^r«^wiwi^fn#s?trt6. 

Clojure Mffl AMi^Hir 
oomwfflIts.Clojure 
ciojure *t 

‘Z&u sP m*T#i$nmft&i8$im£. #5ij^^cifw^n 

FORTRAN 

Clojure 2EJA Lisp * 18&TMWMlft 


• 255 • 



■■■I JfQIXUEXlYUANl. fJ lyiNGYONO 

tlo W(DSLs, domain—specific languages) (ft A 

< [fn^fiXT SQLCClojure QL)fP Hadoop(Cascalog)[$ DSLs lilEltiijLo ^ 
Clojure mmVt^lg'frT JVM Java gff^i&(5] 

ciojure 

. 7iifgM, asi^m m . #u 

(Citigroup)(the Max Planck Institute),tfeS^fS£ 
M7 Clojure 0 

6.3.3 R •iS-'s' 

RaWSftttffl^&iH^WaiattffaasaW. RaWM« 

saW£«M*.MsaWM£Jiifc£l&W^ 20 tftSE 70 

M. R aWJ^arB^WW^A^MW&A#^ s fn splus(8- > ME£eI3 

r &rm n a 

irgSffl.ftfefii'JifeiHfiSf. AJSirfflfci.ASI&fl.fciliaaff 

(Bank of America) „ (Google) ,jW P7M/S (Intercontinental HotelsK iftiiL 

^^](Merck)^MI5(Pfizer)^^)}$^^(SheU)|PE^di7####WS 

Mfiffl7 r aw. 2013 ^ 9 n tiobe shaeaww^wi*&+>» r 
w^Fieaw+aSjftfflwa is ©.ajaiasw^ 1 s awfn s-splus, jgfi 

SAS(^ 21 ft)fq MATLAB(fg 19 fi[)a#WWlIliaftW*^#ftffi(TIOBE, • 

20i3) o Raww±wr*.a2oo9^A^w« 

• a 1600 

r ignMmmttffiViM*, r ms&^^A£mmmmm,$L%RVtmm 
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J&PF^JT'^dDEs, integrated development environments) -.MityirMFftWi W&tJ, 

mm. MATLABfPSASftrtM^W^ff*^*Wif- 

E-^MfiEW^S^inp^t/f^'pJCRevolution Analytics) 

RaipeES^aflcfp^^iswT-^ffljittifes.^KtittRSWJR 
* * - rt # m ,«(hi @ b mm if &. a 

is.iiiinsm-irfn Hadoop 

Ri^g Snow, Multicore fD 

Paraded RHadoop fD RHIPE 

B&T RHadoop ifP RHIPE, &#&&&#*££ JliEWlfcftig 
CPU 

JIHiiitt&RiSirW U PP y()g»*iliff^^®*#i3EfflTy!l^ + WSf^ 

o 

Snow R it*o sockets, MPUPVM <£ 

Net Work Spaces tfe^?¥^j&;2l|H]#nL$JiiS. Snow ^LflJFFH^t^iJA^HT 
3B«.ft*5 snow 

CPU 

(Bootstrapping) 

Multicore POSIX *§#l£§ 

(OSX,Linux UNIX)±istfW^W R 
its. &M Multicore RAM 

Parallel £—'h#friM : rfe.'E& R 2. 14 '£ 

POSIX Windows 

Parallel -fej Snow fP Multicore iS$(fRM 

Rtt.nTIUlfltfS Snow IMBMfjfe. 

Rhadoop fP Rhipe R ia Wtt Hadoop iS^T£S?Sifrf5] * amap #P re¬ 

duce li^-nTEUfia R -S: Hadoop HlFF 

6.3.4 Python 

kk 20 ttirlE 80 Python 
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python nr 

x» pyxhonM-nrnnrn^m 

tgsfll JVM®WH. MM. Python wf&m'fTBraiVim&Wg API 
ffl«^i$MFORTRAN > CfnC+ + 0 Python ^SJfnmJlr^MGX M 
JVM ®=,Python 

tkfc*. Python m Wife«1 ft Jython M M S X MtlfJ JVM 
Python . IW£MW£&%& .^IffnTOJf. 

s . python wrtg^ft&sax*!* 

SQL ^ NOSQL Python 

vim sdpy mm Numpy if £a, tinmm%% xm-JcfmmmMmtttirm 

tfcif %k ff . iff Hi I® frfj Python If, to Orange fn Pattern 
API. if Matplotlib Jf Python MUffl Ha- 

doop W’/lK.X^r^^fi!c MapReduce map ftl reduce Ja^o 

ftjfi-Pjfi# scikit—leam Python 6l£lf 

«x*fitir* o. i4 js*,M&7ifr£WJSM# 

Python fj sdkit IDE mn&W&gi 

Mfgtt. fe^ifcs^ %mm ,#hmk r #aff £ wti. 

6.3.5 SAS 

SAS * 2013 ¥ I DC ,SAS XttJIWm 

*Ifr##«.toiLtMtJ§M 16 ftJrfr»MSf. SAS 

1976 4 JimGoodnight 

m±m JohnSail 

*SAS/STAT,SASEnterpriseMinerfP SAS . £*ifi#J«#M»T 

tf (Forrester Wave)»fP'‘lS^J^.PM(Gartner Magic Quadrant)”X,SAS ELUffli 


• 258 • 



$ 6 

r&mumo 

fikfn * raft&ttM ,»§££/* #m#tb « e a . 

^E{t®Wo iittlfc# DATAStep. 

sas n&mmx 

sas wM*rs;?0fi&fiE. &-«#* 

sas m r-x^ffi m Ag p ft (W| fi>t ittg 

MMlii+JTMo &>N*#tt*jc* PROC Wae®*#j£#WffiGMM«! 

ife.SMH REGeffji^isiia^aijff^jaw.a# univariate 

tHawiip#. it^na-^fif^ttffii^.ipaff 

Dataa; 

Setbend=last; 

RetainX; 

Sum+X; 

Iflastthenmean=sum/n; 

Run; 

b 4 , £«- > h&rft»lg3l. Retam 

ft sas mftftft sas $n$ 

»§ll'll :n *. SASffl^a 

^f-^WWnra^TiSfc: 
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Procmeansdata= b; 

Varx; 

Run; 

m&mm&z # * w « n * (m in. & m tie, m % m & jtfdi m 

ffi*l"!H). SASttftftSAS/STAT^a + tfc^^S#. ftT&ifiWI" 

SAS/STAT fl-jaa 9300 Enterprise Miner ffllJWSiil 

2000 jff:fc£. 

ti , FiopcmmMmx&m ) mhm&. 

6.3.6 Weka R &}K.Z£35-Vr 

Weka fP R SW+fMegSMt#, 

Weka M««HUil00%M Java,Weka 

Rji-^aMwsEtf-jfiat.awaa. 

Weka M R *JK±&-# 

WekaMUttMS^M^ffiM* 
+ . flrWMft R .>|&Slft We¬ 
ka * . arff);ft Weka (in: . );hk 

Weka $*;&'']%Lr\'1t( flR : sensitivity, specificity, MCC.)„ 

Weak m R 
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$ 6 

6-1 Date exploration/Visualization 


Fature 

Weka 

R 

Descriptive statiatics 

V 

7 

Frequency table 

7 

7 

Scatter plot 


7 

Scatter plot matrices 

7 

7 

Histonrams 

7 

7 

Tree/Graph visualization 

7 

7 

Boxplots 


7 

Precision/recall curve 

7 

7 

Lift chart 

7 

7 

ROC curve 

7 

7 


6-2 Data Preparation 


Fature 

Weka 

R 

Sampling 



(Iversampling/balanceing 

7 

7 

Random 

7 

7 

Stratified 

7 

7 

Discretization! binning) 

* 


Equal width 

7 

7 

Equal frequency 

7 

7 

Supervised 

7 


Recorder fields 

7 

7 

Identifier fields 

7 

7 

Normalization/standar dization 

7 

7 
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JIQlXUtXIV { AM mu rWOVO.NG 


Fature 

Weka 

R 

Binarization 

V 

V 

Derived fields 

V 

7 

Outlier detection 

V 

V 


Principal components 

Random projections 

Attribute selsction 

Trees 

ID3 

C4. 5 

CART 

Decision stumps 
Random forests 


Best first tree 
Logistic model trees 


MS model tree 


Alternation decision trees 


Interactive tree construction 


KNN trees 


Rules 

Decision table 
RIPPER 
Conjuntive rule 
M5 Rules 
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W. 6 



Fature 

Weka 

R 

PART 

V 


Ripplr down rules(Ridor) 

7 


NNge 

7 



OneR 

7 

Ensmeble Learning 


Ada boost 

7 



t LogitBoost 
Additive regression 


Bagging 

7 

Stacking 

7 

Grading 

7 


MultiBoost 


Voted classifier 
MetaCoat 


Ensembles of nested dichotomies 


Clustering 



EM 

7 ' 

7 

KMeans 

7 

7 

XMeams 

7 


COBWEBC hierarchical) 

7 


OPTICS 

7 


Farthest first clustering 

7 

• 

Hierarchical clustering 


7 
















jiQixntxfYii Awnji’t iscvosr* 


mm 


Fature 

Weka 

R 

Agglomerative nesting 


V 

Fuzzy G—means clustering 


V 

Bagged clustering 


V 

Cluster ensembles 


V 

Convex clustering 


V 

Association rules 



Apriori 

7 

7 (Via interface to third pary app) 

Predictive Apriori 

V 


Tertius 

V 


Generalized sequential patterns 

7 


Eclat 


7 (Via interface to third pary app) 


6-3 Evaluation 


Fature 

Weka 

R 

Prediction accuracy 

V 

V 

Confusion matrix 

7 

V 

AUC 

V 

V 

Information—retrieval stats 

V 

V 

Information—theoretic stats 

V 

V 

ROC/lift charts 

V 


experiment facility 


7 


^ 6-4 Deployment 


Fature 

Weka 

R 

Serialized java object 

V 


Java source code( limited) 

7 


PMML( limited) 


7 
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% 6 


6.4 

. mt&B 0 MAAfn 0 

20%~50%^fa] o HiifcRrwa#Ttt,«iftTwmft^Ri 
®,±pg4 3 #^nT«ic#^^-*A^= + SftW]E*3«S3fcK.**^£: 
m +,2009 m&ik 100 

wifia 4.2 ai-.m 360 f Ara^-jgji.BBs 

J^ttr,, 2012 Google ^^IIA1*9^® JavaScript S^|n]^ 

JavaScript H&fgHA web , «T WJ»«(3I#S^|fi]PJ*iS 

'h Web K.M'EXfnt-ilM Web ^WJMAWK 

»J. ra^A^-^iiic*IE^W Web5i4 5 .±^^JffiW^^^MAS, 0 &j» 

^Wjff+a^sJWF^e^wiWf^isiiiia^wHWffldtw^^E^ 

M««{4 A S W^«dg,*@c»«A s w,-«*at 

a- m *?fe± a^/b , , jit04n^«fc >4 vm 

R5iA^( Webpage Trojan) BM A Web 5££W#3FJ*». iHfaW&ife 
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■■■ ngiXUtXlYI-AM IJIYINGVONG 

6 . 4.1 

1 . 

7*^#Aa^tfc&^j&M£¥,fBJil^K*^(Web Trojan) 

imillWW#. Web oJ^ji-'t'#^ 

M Html Web 

Kttllt'fTlE'ffi’frjj Web 5l l 1‘ l »fljffl JavaScript^ VBScript A^ijSc#® 

URL 0 

2 ,, &m±£m am 

2001 ^umthmaji^m 

mimebmp 200A 

Wf##^M*£#tt,JACHM |«]K*I^Flash [tf|K*^>WMV 

fam&gmttxim rmvb . B#&^w^a*ibSE 7 

itaWM»5(l^*,ARP»:l8S^,jiiiQQSE«afflpjft*tta^. 

2. psnff*^w^*^ 

dwt. wM*^waiaffi»a*ww^3c^»M*i“a.iG**iW2|taAM 

AWMJF^ 0 if J! # .^ji^aHL^a® M Mfe? Wtt, ttllift 

,arp nmrnm * 

a£fc7aa»aa#a&a. ±ji&a^±5Jiffla«w±f(ia*,«iinffla* 
* M a Wo ip4“j»*^±^aW4fiJtE$^Min®5!i,Hjftis&Mfsaaaa 
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3 . 

ku.itnwMmMm’fcm&m* mt 

t:fW W 1 tjgl itV MMX W«^. % JfflJfl.## -3 "TEJt M 0 & * B %\m ft 
fi^w^jij. mt&m^mvmm, mmmm&'rn&MAm . 

a ir. ias*s+#j®». mzirm mt . 

«s*iftfT&?[:i8*&j&##r , &&<w * mmm , 

Wttpg^i5i«. «^#^tff^rfe^r«^w®»45iP»iR45Mra®. aft 

ws%aa8fli$^.i4S'e**wttj^. 

(2)^jtf^Mms7ft 

¥#3«UPI#* T^pfiEKSje, , %r WMtt, £ 

#. ft #IB ft mrUT, a$± 

&****&%%. 
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■■■ llOIXOEXlYPANI.IJl’nNOVONU 

js: , . mvmmmwa^m^ e mmf&mn . 

6 . 4.2 

K+A^WjftSftftMareMjiae^fiEWESBWtstw 

£A, K-{L££&Mjri*. mt E ffiflj 

m%MXo zh& Html ^(JavaScript ^) 

-M« Html Ail-4- 

i a mmmmmizm} 

Htmijw. m&,& 

. wunsraM a 

l. 

K*TmttW»WttMiesi,*W^WfTik#llttT Web 

m&m. wM^xts^wfflpiSf^w^swroi*. siMtmiiftArt 
JavaScriptjw^AwwM^^iseiftw^ia. ®&kK&5 

&i+-i(®E JavaScript 
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$ 6 

rt wihw , mm wt m 5* 

m E*J A *!£#!&m tit: URL m g #•, W ^ «§ A, #fiE & m m& JavaS¬ 
cript JavaScript £ 

6-4 0f^4o 



a 6-4 fc&ufiw a 





a 6-5 a if *..% *hh m a 
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mm JIQIXUKXIYL ANl UIV1NRYONG 

<l>W$fc.fflPHA5ifr|5J WEBN^W URLi&it,^gE#^lS] URL 

url„ £ 

url *r a 

Mo £TOra,jM&wffig&jfc. 

JavaScript JavaS¬ 
cript JavaScript 

URL URL n£#.4u £ 

* . mm p wmmm ra m . 

2. 

satHi tb mis. h 

im^zfsn 

6 . 4.3 m7ii*.i3,*kmj£.2LMkTt- 

Wjff*3*tt±5* URL^«^^,W^JfeJl,#fiE|gm^,JavaS- 

cript £?DS&ife,EP JavaScript w*m& 

MfiSU , 

i. 

JavaScript BP 

#S««ifelP JavaScript 6-6 0f*. g 

* url M^^ttJKFfflp^AeawM url url $ 

jTii-tk^,^«!niJ^fi»]Jf3UMo W^JfeA^iS^^aTftRJOi 
59>Tft js URL^^#^jfgo 

JavaScript &£fe££tfcM—tSM&o 

.T^fiEEEW^^Watjft.WXd- JavaScript S HU JS Jg 

HWfifflBStrg. GoogleVB -J| 
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JavaScript = 

4#fiE»«t8S£Xt JavaScript 1 N-gram #£E 

JavaScript WftfiE. BP 

feMK. 



a 6-6 ^^^a 

2 . 

6-7 0f/X. 
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® 6-7 


(Dtjfe.fflPHAUttN WEB mb® URLJfctt.Jfl^MIBifeiWflijE 

M3HS5tfc*l URL'W$WSM£. 

<2)£ URL URL 

«£#- URL fcigjg* A URL 0 £ URL 

&«!%£$&. 

JavaScript m*UXR JavaS¬ 
cript ^hoPSS^WJ 7 ^' ft JavaScript 
( 4 )f 1 Jffl JavaScript 

^ffl^±ttl5IWtfi.^URL«iD»«#URL||«^'t'. £5WE#P*, 
3 . mmmmm 
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% 6 

mmmfto 

m^.M‘)fe*-#M^IE'«'l«15T(^IE'tM JavaScript BiP*WTO)fi1 
JavaScript GoogleV8 B 

m&mm, 



a 6-8 fc&g&nu&h&n 


• 273 • 










tna^3]jsasfiffl 

■■■ JIQIXUCXI YL ANl IJIV|\r«YQNO 

s-sm*. 

ftm w* jh . 

^RttaaT 100 >!^rss* JavaScript ,MfiHa#jE##P*fli 

vm&WLS.%mtmm. 

JSXfltfWP URLJflsitm^scripO^artW JSjftl^. GoogleV8 

w^iaa^ejsw+jt^jamsw.wfflN-gnimafiEaaft^a^ 
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$ 6 



IS 6-9 jftftb&J&lfraM 

4. URL 

url.url 

igl¥W^.#|w|^ll««iiJ:ii-it Vs tH$5; . 1*1 Jktmmrnmp ,ffl 

^TOl'fi],!)}iJ1tfJJM^m o gxfm® 

&P|?I 6-10 

URL.URL 
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■■ JIOIVI | XI vu a\! IjrVlNG-Y 

#P|fl 6-10 



a 6-10 url.s 

5. 

H»JffiAX«ScW^»#|c(webspider).'ej|->MBM l W^±TilWM#l. 

URLfi|ft,#«t<script>fe3£rt«^. 6-11 mm. 

ra^jnsAx^ffieftiT: 

(1) ttflj Winlnet » 

(2) f!jffl hup mm Web 

(3) nMftm,feft HSLh W URL fgg JS *#*WKI&; 

(4) JS£{*URL^J£AIA?'J; 

(5) ut#>h js url js x #; 
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$ 6 

<6)g js url . 

i&'+r$kW]£' 

JIM® url fii#wn«iws<8cript>is» 

script></script>#^F t 36tlrt§iE!fllJ^ji^:$PT^f^:«] * >[\\s\\S] * ? 
<\\s * /\\s * script\\s">\\s * script[*>] * >[\\s\\S] * ? <\\s * /\\s * 
script\\s * >)") 



a 6-11 


6. JavaScript 
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■■ MQlXUEMVf A.vUJlV WGYOXG 

JS JavaScript I®*#*#, 

fjjfttj 1^ eval «£ document, write %ff&$fri>£lW%fo 

(l)IE#ifl«M^ 

jE#p^w«^Miaip 6-12 ft?*' nmMmmiiuTo 
®fm&iR]E#iw*M uriw^mn Ai ex ra.as 

wi*3c^it-» tt«s, «*«*««*, jiurio w wk& josmiE wmm. 
vc$m* 

#|iPWo 

JavaScript 

Xft o 

®JE#^®W^E«li±g 2 KIR±®tJi#*^Wiie. 
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® 6-12 SL% 


©Ali—http:// WWW. malwareurl. 

com. 

©jsunpack—n H—#ST SpiderMonkey 

JavaScript M# 
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■■ J1QIXHI XI vt AM MlV|\OYO\(. 

*o jsia yara ajwj#4a#j-«* 

.iSP^o Rlsft http : //jsunpack. jeek. org/Jh^ MJK^js:jsunpack —n, 

6frM£ WP* - W*P«. 



a 6-13 ' 

7. JavaScript 

(1) J avaScript 

JavaScript P*WJ&5£, 

JavaScript f f g. JavaScript p 

*&mmm ,» Jq* • pflsttwwa- ppftsi#®. wg$ 

JavaS¬ 
cript p2M£l!L 

(2) GoogleV8 p$£$&#i 
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$ 6 

GoogleV8 Mozilla fi'J Spider Monkey IjJl §—* HI—JavaScript* 

ttEmizmx 

Et?S*ifettfT*a!W JavaScript jStfflSJf 5 % 0W. V8 *f JavaScript 
&L% loop JavaScript 

ft, 31 JavaScript 

JavaScript § &M V8 - i® 

JS ffil* WflUSSiTOfT n-gram 

mm&o 

8. t#MM&i5it 

(l)n—gram #0; !§.$(££ A 

n-gram W-#Kl£ 

*7 n ffilgvp^WSffltUS.^^JnllJJUiST^^MlCharac- 

ter)lftprPJlJI3£^^fKl(Word)o n—gram III Tin WHS!ftl© 

1HR54. N—gram ##rEI£lKl#J!&fflTMI45H£. 

n-gramn-gram 
^ N-gram||+iSiatfl»^*(BlW«pffi,«FB^iSc**nW»tllfirP**« 

gram IfjSIifcfScBP PTIfSO n—gram 

Mo n-gram 

&T® P§&?&5&-- y NM$[-fcJS. fcfc$n,010573eel3b2,J£*j-J!&lft 3-gram W 
(010573),(0573ee),(73eeb2),(eeb2b2) o £ 1994 fl3 —ft 

*TTT n-gram n-gram njlilffl 

g ramJireJffifflW«pffillJR*-fe. 

gram n-grams 0 n - grams W 

I2,W n—grams 0itfc < n— grams jf'feo ]IJlMSllAftl 
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■■ JIQIXI 'tXrYL'AWLIMYINGVONG 

W n-gram 

(2) #$E&#&* 

MM n-gram 

if ^(Information Gain,IG)S.8*tT— 

£®mm, gram dill 

ifefclf iHS'hM gram ffinTfefl^tiEMWItS. 

«X=(x,,x,,-xJ,!iId$#XM#ll)£^* 

H(X) = —S/>(Xi)logz(/>(x,-)) (6-1) 

I 

H(X | Y) = - L>(^y) Sp(x, | y,)log2(pU | y,)■) (6-2) 

/' J 

^(6-2)^,p(x)Ml x Y M# 

/G(X| Y) =H(X) — H(X | Y) (6-3) 

/ A^(6-3)ife0J*TY6Utti«M, , i , 1 X M«4HiJ&AUlif#»X Mft&ffi 

TI#o 

(3) n—gram ^fiEllJ&iifl 

* H 6-5 JavaScript W*#*. 

n-gramtffi«Sf)^il@„ 


• 282 • 



$ 6 £/** 

^ 6-5 —'t'Sla JavaScript 

functionkillErrorsO { 
returntrue; 

} 

window. onerror=killErrors; 

eval(function(p, a, c, k, e, d) (e=function(c) {return(c<Ca?"" ; e(par- 
selnt(c/a)))+((e=c%a)>35? Str 

ing. fromCharCode ( c + 29 ) : c. toString ( 36))}; if (!". replace (/'/, 

String)) {whileCc-)d[e(c)] = k[c] | 

| e(c) ;k=[funcfion(e)<return 

d[eJ}];e=function(){return , \\w+ 1 } ;c=l;} ;while(c-)if(kCc])p= 

p. replace(new 

RegexpC'XXb'-t-e(c)-E'Wb' ,'g) ,k[c]);return 

p;}C'6(b("c%e%2%4%0%5%d%0%a. 7%2%8%9//l. k/m. o%3% 
l%n%g. f%3%l%h%4%j% 

0%5%i")) ; ',25,25,'0D|2C|28|22|29|0A|eval|DloadDS|22http|3A| 

0Acom | unescape | function | 7 

B| 20DowndloadCalcAndRun | exe | 22baidu | 200 | 7D | 3B | com | 268ip | 
baidul 1201 cab . split( 7 1 r ), 0, { 

})) 

DowndloadCalcAndRunC) 

mm Goo g ieV8 js 6-6 

m r m ai . m *nm . % - m m m bspm m m , % 

is£4«jfc/bjfcfm&jg?s n- g ram tfimwmmii' 
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£ 6-6 


55 

pushebp 

8bec 

movebp, esp 

56 

pushesi 

57 

pushedi 

b835011000 

moveax,00100135 

50 

pusheax 

56 

pushesi 

68edbd0e00 

pushOxebded 

6a00 

pushOxO 

e8e808ffff 

call00143300 

3b25006a4301 

cmpesp,[0xl436a00] 

0f82fb000000 

jc287(00152BlF) 

8b4617 

moveax, [esi+Oxl 7] 

50 

pusheax 

b925541000 

movecx,00105425 

e88ee5feff 

callLoadIC_Initialize(00140FC0) 


fljffl windows #fc£fci!53c linuxshell 6-6 

JCifi®* fc4-tt&W»fW£J*£ 6-7 
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& 6-7 afMifm'ttttii**# 

push 

mov 

push 

push 

mov 

push 

push 

push 

push 

call 

n-gram n J&{1[ 2-gram gram {±SSfiW^tlC, 

6-8 0fw,Jto mov.m OV 1642 &„ 

H 6-8 2 —gram ^ti+ 

mov_movl642 
push_push850 
mov_push556 
jmp_mov458 
code_embedded4 5 6 
mov_jmp450 
mov_call436 
position_code436 
embedded_embedded428 
embedded_statement422 
push_mov414 
push_call378 
call_mov348 






■■ JIQIXUCXI ViMNI. fJI VINOYONO 

(4)n— gram 

^HI(ClassDiagram)^®^X+^^gt UML 

MwssHio 

— ^5 fft 3c ^ 2 )2 it ( Generalization), $ JSL (Realiza¬ 
tion) ,{&#!(Dependency) (Association) 0 ^ l t , 3£?£ —)l&3c®£3£ 

^'ftl^'n Aggregation) ,-h (Composition) „ n —gram f#|tEiI^Xi£ 

6-14 



@ 6-14 n—gram 3 c @ 

9. 

( 1 )BP jtgpjljl 

Artifical Neural Network)!-^. 

f Hi If ] M fl * ffl 2 ^ M" f >f' & X” M £ $, ft m ^ r|i $ 

tm\mxm . 
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■■■ JlOIMJEXfYU \NI UlVINriVONO 

I fin 6-17 0f^. 

c i * mm-imm, 

(3)itjr#M^ii ah aj {t#^7cmjg»® ®tmc» & m » 

(4>tt-JMfttflMMig|g E(</>, M E( 9 )<e,PJtt^^l^l|^^or«ifdl 

n$ bp #gw^#s««awtii#^gwiii|gsaeiBiT. 

©£nSiJl|££# ; fclfc#§ft'a D = {(j 1 , 3 ©, (x 2 , 3/2 )-"(x m < 3 /„,) — aE 

mm GoogleV8 JavaScript + 

n-gram ft 

gram jgfe g ngram ^C#o 

©jfcB^j&lr##*}*^ gram 

gram 

n-gram ffi£mL?‘ 1 *ktoXRffiE&3&K£,ni HMSII 
ajSBM 200 >h gram#ffi^*K^HS'JW#liE^fio 
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% 6 

* etj^fiE. n siswifij* f ={/,,/„/,•••/.}rnnrnm . 

n-gram gram F 4l 

3-«j«rt£. ingtea-JPJM 

l-"0}^7K#2|s:^,^-#tiE f 2 f 3 „ 

Mm*m%'i„ 

AadBoost H$ BP . f 

« i5^^7 200,*!;£-&« 
ig^i^ttan#aatffisi»iKi»:,#^»m % 2oo,£+jE#w*»*£W*» 
ffPg-ft 100 o 



»AM l&Ji »il3S 

m 6-17 4^ BP#&Rg>*g 

<8)#>Mfejg» BP W>l5W^«i#»a*inT:**i;ilSSft»«S* 1000, 
le-3,|S^»a** -0.5,0. 

5). tm&mimm bp jS»b .aftite 
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■■ JIQlXliEYIYLASl iilVINUVONG 

lo^mm 

ft*fmMm\)o 

®si 6-i8 bp n&mt&MMm 

#R>Mqffl 6-17 J9r^W bp tt®H»5it#*«dg|iaEff^^,K^tlliraBB6-l8 

20. 

Output 



ffl 6-18 BP#«W«.|tA*fi 
io. 

) 

n-gram gram g > ±3HS1^WT fg 

!,;gram ^|^,gram & g A'J l£Hd|W] i?£ EltlH] ^ All A 6-9„ 

A 6-9 n—gram 






itty 

id 

int 

11 

N 

±& 

gram 

varchar 

50 

N 

gram ^ ##<{£. 

num 

int 

11 

N 

gram -Hit 


datetime 

0 

N 

4'] & a 48 


datetime 

0 

N 

if a a 48 
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$ 6 

TO URL 6-10 

URL.-eOHtRl ,|it#I, 

316-10 TOS£i£URL3l 




Kj£ 


mm 

id 

int 

11 

N 

itt 

Name 

varchar 

100 

N 


url 

varchar 

500 

N 

URL i&iiL 

createDate 

datetime 


Y 

i>] & a 4B 



0 

Y 

il-ft a 4 b 




Y 

4->i 


#o3t 6-11 0 

316-11 n— gram 


^a^ 


*£ 


mm 

id 

int 

11 

N 

i# 

filename 

varchar 


N 


Feature 

varchar 

500 

Y 

4: 

createDate 

datetime 

0 

Y 

it a 4 b 

modifyDate 

datetime 

0 

Y 

fl-a a 4 b 

class 

int 

11 

N 

#■*«•£**] 

remark 

varchar 

255 

Y 

4Ki 


JavaScript JavaScript 6- 

12 . 
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*6-12 JavaScript *#* 5 |* 



*2! 



it 3 )] 

id 

int 

11 

N 

±£t 



100 

N 

JS *.+Nfc*t 


int 


N 

id 

jsfilesize 

int 

11 

N 

JS */#*.* 

jsdilenumber 

int 

11 

N 

JS *.#*-$• 

createDate 

datetime 

0 

Y 


modifyDate 

datetime 

0 

Y 


Isobfucated 

int 

11 

N 

js 

kind 

varcha 

255 

Y 

JS#* 


JavaScript I*,in* 6-13. 

*6-13 po3SfiX#^?l* 



*2! 

KJt 


it a )\ 

id 

int 

11 

N 

±$L 

url 

varchar 

100 

N 

> 

JS it 

dir 

varchar 

500 

N 

3 * 

Creatdate 

datetime 

0 

Y 

44 £9 40 

modifyeDate 

datetime 

0 

Y 

ifit 3 $1 

Remark 

varchar 

255 

N 

4H& 


6 . 4.4 

wm^*0£±5* url 

JavaScript £OS£ife>BP Wi&m&M 

JavaScript 
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6.5 

m&mt 

W,AffISf3fe^»iIW,<iXJi»4^rMWffi[Ji.»»iR«l.£ta. ikM^.% JJ##. 

iSaW^ftlWaK^iEBftlW^tt.^jt —Meta- 
Group 21 tft 

Mi-'I'&XM.mfim&laLmM&X&ft. ttiiieaWiB^rft^nu^WA; 

MM1I. 

6.5.1 

HAM^MW. fX£ 2013 

l. 

fiStnn s 

*fJg$E 0 n p 

0<jW^MWSfiXmitS.§fWp c ;i)»^ : t^MX±nffi-XWWS^7X i Fo 
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2 . mmim* 

am -#.^pwmg o ^, uwr& 
ummm w tfc£«t @&we 

m— isiicsx 

SAiis] 

-*»ig#«f*^aw*a«^tftta(MPP)»igs 

*.&«!»&#<$* Hadoop +,a^r»ffe-*»|g|!E^* HadoopiilX£ 

Mpp»«#a. 

tg&WAXMil. 

■ illg*, Afe*«6^jXX/h^m0^l'0]® □ 

(3)^,«ll^„ ^fa#MIS!l(Sa 1 :tf?'J),MM#XJi 
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. W = ^3WJ « M fsm tBffl3j£fli Jgib attfil w« h . 

MiilTt*iEIf-ttai„ ^m^14^#a##ttTt$5iJKfl!i»A$ 

(4)*0^,ftfnft#ftg^,^*iRJgiJ(5ill«fflriB*Jg. g'hfrtffTO 

ffl5®W|i5]So 

jm*&. mmi^Tmmmm, 

m&&&m 341 123m», a 

297 113 A4 km 
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■M ITQIXULMYIT ANLI1IV I.NOYONO 

sa*ai&. A 4 EWfflsaR.^ai 632 fe&x 

. 

(Functional Dimensionan Alysis.FDA)^#^-^- 
(Symbolic Aggregateappro Ximation, SAX)-tilM hU lit>?ft„ 

Mffi&fniflMRgafr. 

^Sn’o 

ffcKM ,H® £ rff W WtflfiEMW.#® PJ E±3 SUfefc^. 

6.5.2 

mmmmmmiii Twiner 2012 5 

fc&t&X o 
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% 6 

5 20 ^mmxtumo . 

tinJlMIlkfjilffiiZcMlfl'Iulffiin Facebook,Linkedln WMKf 

tf&wvm mm$ mm vmMSh m mmm^imum 

&M,$C)&itifc Twitter,6 

(swiRjsnsfi®w*-^. s 

*{*±,Twitter 

I 

&mm gps jefiMBsHRjMifc*. (tiMmmisfo* ,gps 

«/j'w*F«:. g § . mm&mn *% 

MTftiti.) 

lcd 

lit # £1 E n to ft ffi if ifcfr, & TO# fa-T> M WM1; fa 
M .i£#£TO^rt-^/% a pM, ^*ffi»Si[>FLWM(^tfl:#ffffl|SI). & 

(3) rt. *tTMrt 

ft Wtft X ffift ft ft % 1ilSI IS ,* * ft ' fr fa & ft fal *, m B # # 8 P * R ffi *M 
fit. 
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tkfcmnmw ft mi 

^hSi^—IS (Frequently Asked Question,FAQ)^®|§^ 0 

WMo 

SWo ^ 

aft 

is&r&mmm&JkM* 

(e)ram „ -mmm%i , mtttm mm 

* ■ 3 ffi (p a 0 1$ Ji-^ 3 AS) W A £/5 W Etf I‘b] ,6 M # S i± 
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mr. sg, 

6.5.3 

pct«w*wwt«M. riMWtig 

^##»*Mla£ffl(APP). tlTlfiilS 

%\t fain n ik it n is • m tb» A$*»tb w m 

%-^toWLm&ik9knu#. 

m%pmft%&w i *M7(!iL%6-u),^'£f&T-^mi£mm&}mmM 

wt mmm^mm Logistic 0 b & a & * n & a a m B m w # s t< h. 
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lIQtiXI'EXlYllANLIJIYINGYONa 


^ 6-14 fSBEWSP—^a«cs* 


t-p 

?■& 1 

/*;* 2 

f-9, 3 

/** 4 


A* N 

%-p i 

1 





1 

t-p 2 



1 




tp 3 




1 



tp 4 

1 













tp N 


1 






@*SK#jt-sp^»ig^*wtisfaTftijiTW 

1 

vrmw, 

* 
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200 ts«„ as-#*###® ltt*® 
mmmffo A««t#,im 200 tTHHiJit 

>N g{1fe&Aj£&IS 
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7. i 


7.1.1 

m\m# o johnTukey 

*JohnTukey#*,M#ffi&-^ 
(summarytable) *P g* pj Uitlf&hK «'* #« R£# M 

m^o R +WS^75rfe3tE^Si»igWi«5^,»J&Wi« : *l« 

muscat*#* he. zis,mm r 

jf-Kas.eiRisiffciB^sa 

MM.tfcftl^Wjft@J.lfe3K»iKW1lfJl.. B*A£®M£3S-#£*je 

waff^^ftigi&ii^s^wRi-awnrafls^fli^a-— w&mma 

#fe,a#i#aih^ma®3(E^rsife*.ii53iffif»sj».itt:n^#igiftiiEiit^ 

rntm. 

ffi tfc#ig##r, , 0r W *$R IJ« 


©DREW CONWAY. tt#^«Jfcffl|SflWWf[>G. ttSC .*l*Iikfflttat,2013. 
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% 7 $-/t/lf§#>l£fflgl#iJfPffr 

if Ip) 0 : ±^{ECmean) mode) ,Hf percentile) ft! median), 

standard deviation)fflTfUKvariance) e 

7.1.2 Tt-A*.«t» 

&®F<£M#ep J&£ A$f *, & nr |g B £¥& 7 ^ Ml to m& £ & 

w rm . a#, m-mm 

R merge,SQL 4 1 W 

jom^^j|^^^fniitiiirii@iwKlllp:*.feiart#s^3tE^w»*li. 
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■■ JlQIXUEX1YU4NUJfYISGY0NG 

nX *'“ft £ 1T &” (dataasrectangle)il ( S M ^ ® £ * 

-wm g 


1 

6 

I 

-► 2.75 43.5 0.25 

3 

91 

0 


5 

1 

0 

2 

76 

0 


M»N 


m 7-1 ##-*»]#* a-*** 
- 5 ll#E»riJ-*ffl. 7-2 gfw. 



ffl 7-2 

7-3 0?*. 
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W> 7 $/0L3g¥3£H£ttJK#r 


M X 2—1 X 1 


1 1 



a 7-3 #-*]#■*■*-*** 

in 2-4 mmj-pmpimmmmmu &. 

f 

MxN—Mxl 



MxN Mxl 

a 7-4 ft- ft : # £ *] #■*•£ — *'] 

M 7-l~ffl 7-4 

pt-w. 

&-B7&. 

7.1.3 «t3&m«r65^-ai. 

ffrimwsx, 
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r 4 >M-*#$sui 5 ij*ra». = 't&m.w&jmmmm&mm 7-2 0?*. 

^ 7-2 RMmmmm®. 

R&-& 

JWig.® TRUE,4t*&te£**#.&*»£JliiS. 

is. numeric 

0 FALSE 

^Aft**.*#**)!*® TRUE,R ttfiMT* *#*#*« 5 

is. character 

FALSE 

-f- (factor) 6 ^ ^-ft Bti&EJ TRUE, @ ^f^E. R 

infe ft -feSL Juft 

is. factor 

fiL8ti4® FALSE 

0 fq 1 ' 

r rt*a»n«f,'eff]x^»jaH^a!. au£#@j£±*&, 
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# 7 


.^^Mii-f:4 i nil'PPJiMM^^(dummycoding) 0 R * 


^ 7-3 S-f-^55 


MessagelD 

IsSpam 

1 

ii 99 

yes 

2 

ii 99 

no 


317-4 


MessagelD 

IsSpam 

1 

1 

2 

0 


H7-5 


MessagelD 

IsSpam 

1 

1 

2 

-1 


3t 7 - 3 — 7-5 

£3? 7-3 *,IsSpam R t 

a , m wa a ®»«&t. 4**i®*« 

£31 7-1-7-4 

^P^S^ESy: 1 ^7K IsSpam JH true,M 0 ^7K IsSpam H false,, 

7-1 -—7-5 

£&#«»!£&+. AffWB+i 1 fn o. &«i*rj£g«:£i6ffi» 
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■■■ JiQIXUCXIViMNl IJIVINGVONO 

7.1.4 

n-nw&Mmm'iamms scviminm^uT 

fn«;£fJ#PJto£.JiiL£ 7-i. 

#*#&**.J65#flMB^?F6l3? 

mmm%^nsLT -fcto 

faji.. jspjia#it5t ,mnm 

Google 0!^o *a, 

7.1.5 JfcTi.3***. j 

Ho R summary SUS# 

/*£ , SifWtASf 6*££T, IT 9tm-m, 

data. file<—file. path(‘data’, , 01_heights_weights_genders. csv / ) 
heights. weights<~read. csvCdata. file,header=TRUE.sep=‘, ’) 
heights<—with( heights, weights. Height) summary (heights) 

# Min. IstOu. MedianMean3rdOu. Max. 

# 54. 2663. 5166. 3266. 3769. 1779.00 

R summary 4 1 ii* 
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(2) »—>Ma4Hfit#« mftW. 25 25%M«[S+*/h 

.WiP^); 

(3) +fi[»(*i»^ 50 >hW4Mfctfc>» 

(4) i${£; 

(5) ® 3 t 75 >hW3Mfcft>; 

£.—*&&£» mm . ft&r * w rt §m, He in 

summary 

«P#ff-^3tA. 

7.1.6 

^luISfo 

£ R^HlSUBmeanS*W*i&ffi. Mj&.ffiiSMI 

ttft-'NSRA^p§ a 

« mean my. mean* R * B WKffe®»"T« 

Tf*Jf : sum Hi length, FJflU'fXM—fr R ftPL 

my. mean< — function ( x) {ret urn( sum( x) /length( x)) 

} 

!4^-ff^.^liW^Jit.StBiJ0T:K«ifil»lS , t I Wfi*«l.fllSJEKJl-fe 

gJMBgM,atiSfflf ^4^11 X 
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DlS$!3fiSS£)a 

JI01XUI XlYl'ANUm INGYONti 


& R + me¬ 
dian my. median; 

my. median<—function(x) {sorted. x<—sort(x) 
if(length(x)%%2 = =o) 


indicesC - c( length (x)/2, length (x)/2 + 1) return (mean (sorted. x[ indi¬ 
ces])) 

} 

else 

< 

index< —ceiling(length( x)/2) return( sorted. x[index] 

,*rft* 

*Wi£ife£+<fc»i»3&S& 50 

MMiPnj 0 ^-i+irm 25 

-'H+w-^-feo u^n 

— im+w ?£&* 

my. vector<—c(0,100)my. vector 
# [l]0100mean(my. vector) 

#[1]50 

median(my. vector) 
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#[ 1]50 

my. vector<—c(0,0,100)mean(my. vector) 

#[1]33. 33333 : median(my. vector) 

#[ 00 " 

my. mean(heights) 

# [1]66. 36756my. medianCheights) 

# [066. 31807 

meanC heights) —rhy. mean( heights) 

#[ 1]0 

medianC heights) — my. medianC heights) 

#[ 1]0 

- > NKHS:3fit»^«i*9fifp , i i (a»sp#j&®nrwffl«TOaawwsiRi*3j£ 

sett. 

feXo 

mm '#. & m^gi . 

7.1.7 3J~£fc*t 

nri5BSittii,4*ft»sit*aia*»*iiw 5o%as>Hfc#w». ^rxt 
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gtmMMM'm mm rnmm-. 

min( heights) 

#[1]54.26313 

max( heights) 

#[1]78. 99874 

c(min(heights) ,max(heights)) 

#[1354. 2631378. ;99874range(heights) 

# [1]54. 2631378. 99874 

tnax(#±<t)^MJi ioo%w*Mg»i*;'e/J'W# i f £ . * 

m#* ^ r 

4>Wquantile(#ft£MIL % N 

IKiMf &T - quantile ft |g ft M 0 %, 25 %, 50 %, 75 % W * 100 % 

(&SAbW#i&. 

quantile! heights) 

# 0% 25% 50% 75% 100% 

#54.2631363.5056266. 3180769. 1742678. 99874 1 

5»3JK{l!l{fc®»M8.ft5& quantile probs ff AM 

ftB: 

quantileC heights,probs= seq(0,1, by=0. 20)) 

# 0%20%40%60%80%100% 

#54. 2631362. 8590165. 1942267. 4353769. 8116278. 99874 
seq 0~1 0. 2 : 

seq(0,1.by=0. 20) 

# [1]0. 00. 20. 40. 60. 81. 0 
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% 7 

mmm^ , a* w9#^»M»arii ut . 

. 7 . 1.8 

tp'bo 

,MT-imMmw . 7 

range §H&t&4g?£B& min(*/Mt)fq 

'max(®*<i)ifcjg, Ms^aife^jiciR^ejK.afliswTw^H*. 

xt»niiatff»<t«®B^r«^RriTW76rfe. 00 ®. omi+im# 50 % 

c( quantileC heights, probs=0. 25), quantileC heights, probs=0. 75)) 

SOTftiiefflr^.ife-^aii 95 ^««w?ehu 

c(quantile(heights,probs=0. 025) ,quantile(heights, probs=0. 975)) 

-WMWLftmmm*M:&lTWmmfeX%1}mvanance)' 
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muffin R&m 

flfli jioixi um:Asi.inyixoVOMj 

&. fikfn^^r—-t n a utt-*® m» wa&a; •. 

my. var<—function(x) (m<—mean(x) 
return( sum( (x— m) A2) /length! x) ) 

} 

R ft var 

my. var( heights) — var(heights) 

r i*ism var wtwfs##«n. bkim±,^vm-m 

*£±.£- 

R MMUM 

m .,n , {£# g &J6&SIM tfcfclHi" n/(n —1) 

W my. var iSlSC^JE: 
my. var< —function! x) {m<—mean( x) 
return( sum( (x—m) A2) / (lengthC x) — 1)) 

} 

my. var (heights)—var (heights) 

my. var . WAft R 

c(mean(heights) — var(heights), mean(heights) + var(heights)) 

# [051. 5640981. 17103 

c(mean( heights)— var (heights) ,mean( heights)+var( heights)) 

#[1]51. 5640981. 17103range(heights) 

#[1]54. 2631378. 99874 
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$ 7 ¥/«l«$33ftAi£fflj|Wr 

^|fK^iejfl ; l : 7j#'1£ll( standard deviation)BP^fitfftT^fltt: 
my. sd<—function(x) {return(sqrt(my. var(x))) 

} 

r *wi*isg»A5 

—a.jtfcgftftR+BWsd: 

my. sd(heights) —sd(heights) 

f 

c( mean( heights) — sd( heights), mean( heights) + sd (heights)) 

#[l]62. 5200370. 21509range(heights) 

#[1]54. 2631378. 99874 

AftH(range)«Hrt. 

c( mean( heights)—sd( heights), mean( heights) +sd( heights)) 

# [l]62.5Zb0370.21509 

c(quantile(heights,probs=0. 25) ,quantile(heights,probs=0. 75)) 

#25% 75% 

#63. 5056269. 17426 

m quantile gftnTUJUf 5J, AM 50% > M*® 

7.2 &£i|fefHf 

7 . 2.1 

&m&nm t . 
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tm\& a m mm Mm r® m t . fa & aw * iwi - >nh m * m -t m *.mt 

s-T.afn* 

f i #P Jp: H 3£3|30;( Amazon. comljtScxi^®. 

mw*# Netflix.com±^*§*1$ dvd nmaa 

DVD,Netflix o|5 

fT-«I^6<J}l#iifflf^AffMfifi«. 

.inUffiifc S-6 % mm, 31$4 a # Mig nJ M §y (tt: 

$n : ^&T,LEDXED),MMHfc^o *f Netflix3fc$,j£^$tlgtil#l:tfeS? 

BBft.BTiaWlif Netflix TiP GeorgeA. Romen W£W® 

$mbi. 

, m%e Gwm w&a %m , n @- ##* w 

(supervised learning) 0 -^j;£.XtPKj % i£ M ^^3 (un— supervised 
lealning), %&&&% 4& AhSft JB&tBi5fc#S W B*P 694ft * £0S. 
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$ 7 

ftp ,lfl-tA^@ M ,$U&iHt!l#£ @ 

MX. ^T-H&ffl&MBE 

ffifi,in*^R*PiS*6M«|nriU«BB^3i*i»ffl«f,(iSi^#ttnrwWffiffl 
m . mzfaimm&m&mmmMfr&xm rt ta jbsmkmuf 

£ 5>3'J!)3 0 Ml*l. 

7.2.2 

KBf^TttfWfi^tt? M#&^rafi,5teil— 
f+o . Afn#WrM:mEo hik.ms 

ttfl^4±&«Mi*rtB«:W£:fco »^Sife.ffi«a£fc##«rfiE£,SPA^ 
ft A#££ 04 m rt MSft ftpft tt nJf&ft^r £ A o 

a^«siw»^fli««tJia®iiwiiip#«-^#Aba. MiXft&sw 
mm m. #>hAftm*ifemi«(%mpft ut, *p «r vmm%±L bpmm m^ iu « 

SPftffiSfcM., 

7.2.3 
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jLftm&te&mik Lf«]@. 

(i > 

&,as mvmfrnmimtmms . &##&*!&»»&#a 

ABiiPJ'J fm -WAS A = ifff ^C^^frPI'J TO, W&±#**M:fc*» 

flgA£-P5 >MbJ VI HitAi££M®.W,$Pitfe±WfflR %m >#£#rt$, 

%%> 

J&fW. 
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@ 7-5 

ffl 7-5 A.'E-«^Tfl 81 ,ft*#*#, 

.Mifc ,j$R& ,ISM M& ,W«$A'M3li8 • , Sir 

Wig«HA«lll^,'eSltll[ffl*flligiMBBEE,M l M^J®^Xf^. 

iTOSEK, &T “ @”¥ Mfe M&Jt 5 ?#.tt“«SB *?#«&”■4> Hib 
tiicirnr. ".ri^siiffi&Eiii.fi 

hb mm mi ,m fc ifc£;fc±#i*7"&*] 
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HB JtQIXULXI YlMNLIIJYIMbYnttG 

mimmmmm&mmmiEi£&mfr%mm., yr&mmjs , mf 

*r vmm ,w d? 
mmicmm^&m i^w . m am + mm mmm w, m% > %& ,f£ 
m &M& , »fiw 4> to^a^od mma&vii 



4M&# 



mn 

>tfc.i£ 

jihal 




4-1* 

1 

1 

i 

0 

i 

1 

0 

0 

0 

1 

Aii5.*M+ 

2 

1 

i 

1 

i 

0 

1 

0 

0 

0 

&4St*M+ 

3 

1 

0 

1 

0 

0 

0 

0 

0 

0 

iii5L*N+ 


M 


B 

B 

2 

1 

l 

0 

0 

1 






0. 17 



0 

0 

0. 08 















89 

B 







i'$•*!*#■ 

M 

0 

0 

0 

0 

D 

2 

1 

2 

1 


*4 


0 

0 

0 

0 

0. 33 

0. 17 

0. 33 




a 7-6 «MJ+S 

ig^t&MlIo. 25,0. 17,0. 17,0. 17,0. 08,0. 08, 
0,0,0. 08,*iE#[fiPf1 : 4 , .4iSil6^ W^-3'JJi 0,0,0,0,0,0. 33,0. 17,0. 33,0. 17 

km o. 25„ 
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SB 7 


ixo. 

25+0X0. 17+0X0. 17+0X0. 17 + 1X0. 08 + 1X0. 08+0X0+1X0+1X0. 08 = 
0. 41,HiEMftMM:lXO + OXO + OXO + OXO+lXO+lXO. 33+0X 
0. 17+1X0. 33+1X0. 17+0. 83„ Ell 7 0. 83 77 0. 4, HjKSrlUftJR7IE# 

m. 

ij&m 4>ji^ p. 

(3>:£*4MFr'Hn 

3£—ft IS . 777# £i#ji£ 7 £n M {£ ffl 7 4* 77 ml. W&ftHnpKF 

*^*«ftosii^in,Egiik*^rttP6. ffc*«#4Ms&^Wi&i£*smt& 

73s . fB & 7£M ftm ft J8>7, JfcM#ffi»#£, £.#IB 

*#£«£ o,Hjtb^#i^*ta^ k 

mm- . ttl^fl^ftffiWfijGifc- T^IWil)ftfflft|-i*$ tt«r : SHisI , 
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7.3 

7.3.1 

It in £±M#iJX*'£H£fl£# 

if. 

&M%xmm3\wm®mi£¥%,®mikMfrm£mmz ibi mm* 



a 7-7 i§-5Ui£$ 


® &m STtn.^gwffAit«[D]. ^i:tt:MJtwmA^.2oi2. 
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$ 7 #/*Fli§^53SfflSg0i|»W 

& a, ±Mis ju* mm«j wi«i5Xo 

Unicode fn URI 0ftt£M?flF*J!iyA XML+NS+ xmlschema 

web 3? as. a=giuii^a^i*w*^a. 

M. Ontology Vocabulary 

Ontology Vocabulary S —M 

. 

-ffl*&W££.#a*i u*^«wwh. 
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■m JtQIXUtXfV l. AMMJtYINGVONC 

is 7-8i^TSf 

w m #xm, raKxg 'mm m m 

zmmmmmz, 

m 7-7 + M Logic,Proof,Trust MfflTMMltttlMM.. tOT&M 

Proof 

7 . 3.2 mj*55-#r - 

m mm A&*mim p tam^m Amm w . 

7 . 3.3 

ftWWS^,faJiMiiAfeMiS.o fa 

3 K jfeift. asftig^^Rr Ulil fftJiff a . 

it mAm ,®imi &Am , mm am® mm am. .&&& m&m 

w» am^m# m , ma its 
ffe»Aft# 7 *jt-£j&. «m 2015 ^ 5 ft ,mmm a&bm »7 7.5 
jk*. be i p 4“ , a a m a# w & * m m w iss mm a , w t& gj n *q ^ n i^ ic . 


• 324 • 


% 7 


i.timm :m-r.«& 4 .m>m 



sl£s| 




3 iSi+^tff A^m iSitS 


a 7-9 rA*f 4 »AJttJ=bS 


IS 7-9 7 #“sjfx” 

ffc£M«Xt giif *|,'B 7“ 0T ^ &, « ^i«5 Afe iliiM VI ft ftffi 


ghuju'fnexij &!*»«»> 




i.fi«#tf 3. 3.m 4.«@ 

5.*H 

i » * 


ahu'iu'fne'xj 




2ftffi- 345^ 


545 

6ft 


a 7-10 a 

IS 7-iojiajfe»Ajfefn*4)tftAft*W^^iiiWJtfitffl. «Ha»A 

J^|^;* , shujufnexi”^^ : | :, n 40 e S'l'filBfTfH T <IE5j?j$fu Aj^i£jl‘‘shujufenxi’’ 0 }t 

$tigft#|jE. ttiTshujufexi-fc-ftA^T-^ 

*“»«##?’" A; A“shenmo”ln , A£*6 tB “it A (shenme) ” ft 

Aft*& 


ihuang'lianl •IJl*(«e> trjj 

lUM 2.«rff 3.^ 4.* 5.a * - 


zhuana'lian 


B 


2 $i’& 3 =& 


7 g 8 tt 


a 7 -n 
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■■I JIOIVTH XlYt \NL!J!YIWGYOM(j 

m 7-11 m&mx. 

M 2015 

&#««* Afuwm^tiUMmmn^ 

7 . 3.4 m*z*&msaL#>JtiiJ*39-#i-9r.&r 

itftftjsimMWMXM'Smtxmp 

x,)»shujufx#**shu'juYx. 

IT&WfelAfe shu £->N?flF.W sj 


XX 

t&X 

1 

s,j,f,x 

2 

s,j,f,x,f,f 

3 

s,j,w,j 

4 

s,h.s 

5 

s,j,f,x,s 


@ 7-12 A 

ffl 7-12 
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$ 7 

mmmmft , #£§r«/f tp 

t 5 5 .m »j g-iii^-^tpsar 4 

W&WLM 4; SfgJiOI'JitMtP«, K-fikMJ? 1 WW. 
tfcira sj fx »##f«s 3,&&if fpsa fxff 

ttiiAT 0 flj 1 £|h], ttftl sj 4/5, sjfx &£#£* 3/5, m sjfx 

*s*f sj nttiMii 3/4„ jikwwii^aflisiif*nriui[«if**-*^tb 



EB 7-13 

m 7-11 

Wffe, 
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IHi IJQJXUi XIVU\SLIilVIN0YONG 

«£ffl 7-13 

{ S: 5} „ { sj :4} „ { sjfx: 3 } , { sjfxff; 1} * { sjfxs: 1} , { sjfxwj : 1h{shs : 1} 

{s},{ S j}ws{sjfx}„ 

a^stS'RWJW^. 

fx. & 

shujufx j£—if 

shu.juj.xiiEg^Tc^o jkf— 

mftfttir. btim^ u shu- 

jufnexi’’S-^?lJ^m.tt^llft#^^^Wy^‘ , .shu,juJ > ne,xi”ii-ff?lJ, 
#S^#i)iL#?yjll^,^ll“shu > ju”^jimjimi5r‘fen,xi”,^tb^“fne”^ 
“fen”WffifljUt,MB'S &\ lEfft^siS. Pk H«'MIBfj 

7.4 

7 . 4.1 




• 328 • 


$ 7 

®ffiilfrAWS*• «IWtfliff6^*. 

« a, MTKfomwm , @f ,* iw] m% % a 

AWKift##.Sife^ffi»aa»5«lJJlJ«*e®M«rtiE,BffA»«f&*^»S 

* - mm . \m Afe lu ita'j , ft #iy 

±Sl^fi!iiyftT.M£^8|5{S[KJlX*l^#I^S#^«Pfit1&«i#WifAo 

ftAl&&MiitflJ®AJ3$TOfflAfl& 
a**#?HJll£,**/h£rt ® ttiJilMS . 36Sjart^m«U3£ - &M 

Mras. 

%¥%? mmmtfi *,w 

«±,3i=#AfeiE^ATMft^-*^y#WftA 
S^»^tiEW^rftAbaifTAW4#fiH^(BlH.a 
AAftTF®ift A#, ftj® M&#T-. S 

W^rfettaifAW».itSWjR^»ltt. X^aftWInlHAbaAfrWjE® 

jw+MMMiBjJH. vimnm^ ra a m » a a^ 0 
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BBI iVQIXl’E\n l’,\M IJIYINC-VO^ 

7 . 4.2 

1. 



(a)3l M (b);KX (c)£4ft 

a 7-14 


Oren t5fe«#7 64X128 WHtffcJfMMrA#*. 

^ 3^[JdW/hiftft^KJE±ll«i«rfiH(inffl 7-14) 

ft#*? 7 bootstrap WA 

&: A M m It'7 BfiflUfe&Jfc-® #*ft * fJ ft M ft #4: ,DU*£ 

ilHSK. SSfc, 

Oren IH7WflMtI. £ 1/15 000 ffti£WF,&*#7 81. 6%MfcSM 

AW3|Eitt,Orenft5jSrft^rW^*^:»-.fillfiE«.Tailft«l-## 

. mw mttm 

bootstrap 

#P hog #fiEfP shapelet #{37 

2 . &mmfi. 

£ 1999 *, 
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^ 7 



a 7-15 

+ chamfer Jg/gJ* 

it^. 

i - 

i 

DcW e r(7’,7)jYJ 2f//(f) (7-1) 

-^j £ t „ chamfer distancetransform 0 

iooo^«e5k 0 M«*«wir.&,£SH m 

ft, mi Gavrila 

mmmu k-means 

itJT-. *m«S«ft5**fflinH 7—16 0 


□ 



/2 il i) & Q 



a 7-16 
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■■ llQIXPEXlYlfAKLIJIY IN0Y6 m. 

2 75%- 

85i~5 m. ^w*ift,iB«fnigif»i.ajiffX®aiwm 

IW. 

3. hog #fiE 

* 2005 ^ Dalai igtil7*T hog #{EWf*j5fe. Oren 

Pt-W^»JK^rW^:»-fiA : ftf-J|CW.tttBfl5lli(S,Dalai 
imj ±.=f-tmw&.'mm Oren 29 £, JSrJi Dalai 

hog#fiH„ 

-HUM#*,# Mit ftA&±&VLi& 3 f-%§k, WSf Dalai g BG'JltT 

-"hJlJtSiaM inriaffA#. 0«f«ff 

ttttlg. * Inria frA&A.Dalai ft^-*$TMTi!r 90% 

mm. rsan 

ho g #fl 0 


Block 



0 7-17 hog#^E.^^® 

> hog J| histogramofgradient 
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$ 7 

, 'mm&fot-, , jb-'M* a m 

HI 7-17 ^iHT hog M 

» hog mife,Dalai 

Dalai 

hog1$ffiW^*tt±5*«i'ei6»«»illiJ(!lBAfrMia«|t1#fiE, 

¥£± hog 

& hog tfUS^BU ’^M&jffiGEEL&^T „ Lowe JitlifKj sift IffiElti+^iifn 
hog sift + 

ffl Dalai 

TBimm , faffiim JfiS/fJTftttftH o 

4. Edgelet #fiE 

5 Gavriia 

^I^.BoWu ISjfcSIffl T edgelet, edgelet MJl—• !&;£T Af£&tJ 

boosting £§ edgelet 

A#jg#. TO Gavrila Wi&*««fflW,«:fr3fe*1lf5Altitt.MBfe 

T®a<nsit*#—#«^rfett±5?rt#o 



eg 7-18 edgelet 
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HH iJQIXUEXIVl/AMl III VlNGVOMO 

bum 7 - 18 m^.boWu edgeiet. mw& 
edgeiet msar/HT’, 

edgeiet 

ffltf + Mfcfcif edgeiet 

edgeiet HI )t *(x, y) ± tfjflfilSi «TfflTit 

it»c 

S(x,y) =4; S/ f (x+h, ,jy+y,) | <N,(x+m, ,;y +u ( -) ,«, > | (7-2) 

t\i=i 

Jiki£ edgeiet t.^ijSI. (u it Vi)Jk edgeiet tfWfiiL 
I r ( x + m,, .y + y, ) H ® >t 4 1 *+ J^Z ,& #J jfi ^ 3S JEtS 
| <N,(x+w, , 3 /+t) ( -) ,iii > | ^7K SI It 4’( x + u,,ji +y ; ) ,^ 
edgeiet 

JA edgeiet W^ + .^SfcnTWM edgeiet imTfti&lgURWftWZ 
*t:#3fe. edgeiet R5JB sobel jrW#&*BP rT,&# 

PlHledgeiet ^Btf T J&* W«S»*■ |"J, M W«C 

ItfcfJfllTfs&o edgeiet 

edgeiet (Zft#Afr«I-/hifc 

EJsi, m T'&immmmm -□ , ms. 

edgeiet g & 

iwti. 

BoWu fflj 54X28 80 

edgeiet, gjii boosting ^lB I'ffi&ibjT edgelet„ Mln&W'fe 

% CAVIAR $f|g#l±i£f!]7 o. 4 ^ 

{if§-llWA.& Mit 

fppw=lO- 6 0t.»feW^-»Jg-i^lii 15%. 

5. Shapelet #tiE 

BoWu & CAVIAR 

edgeiet 

edgeiet • $J#0 1/4 |H3lR?^^] edgeiet,fBjA — -rA^ 
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$ 7 

±6<j|S|M? a^r-#ft«fWft^#3ltfiStWffl¥X«j£Wedgelet3t6^JS . 

^^^j^lMlIs! Sabzmeydani 7 2007 ^SlfcBT shapelet % ft, ^lj#1 
JB^AWtSc* a Hog 

lofgf! 

fiE,m& shapelet £ft + ,# W £ff 

AMitiwimffii. ^aftwateint. 

»A:iims5#^n 

lowlevelfeature; 

ffl boosting shapelet ; 

( 

JttilllSSaf W shapelet fffcJB boosting, 

lowlevel feature flj shapelet ;ft—. i£f£#*£j5C 
W lowlevelfeature * 0 ® ,45 ® ,90 Jtfll 135 ItE73Tfr ±fKj&§fc( IH 7-19). 
$f—lowlevelfeature boosting jftfftfrii lit idlin'ft dTW#SU — 
7 shapelet ^tiEo 



SJ 7-19 Shapelet 



S] 7-20 shaplet edgelet 6\>^3'1 
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■■ JlQIXlJEXlYUANLtJtVINGYONC 

^E® 7-20 ^ edgelet ft shapelet ftAli 

edgelet,shapelet Mt6“«f£"A 

inriaMn±,m»^ij 

4000 ^rn n 0.04 

7.4.3 ^--3^ boostedcascade 

^rfettftffilK6#ffil^W3l6B:Win*edgelet ft shapelet?g£WW 

boostedcascade„ Viola Mfii 10 fn 

IH&flftHl W&i2o boostedcascade % 

ffim, 

, xt7® a 1 4> *8P#*#8if*MK# - $n 

Viola $1# W boostedcascade ^£fetnfn Hfc$?#£7:S7A*t 
g. *t7#£EM. Viola adaboost g 

Mii#*^W#iiE?OT^it}|:a^J$.VioJamMi7«#SE^^® 
Viola Hiti7a«W^HHS^HKcascade), 3GMFffi#M1!f*Kfc. 

mmmm* 

. boosting 3tEjS#-W4Me^«PfiE«||jUi^»» 

*r#IBJiftffl bootstrap 
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$ 7 £Vmt§^5]£ffl3g0iJ)R#f 


&m£m£miV 3 »sm® 7-21 &m. 



@7-21 boostedcascade 


nil . frAfeSJ 't 1 W# JSLM o 

l. 

Viola haar^«[W3e^fiH. 

ffl 7-22 Viola 


HfflB] 

Type 1 Type 2 Type 3 



Type 4 Type 5 Type 6 

® 7-22 haar Jft-fi'iN -f - 


&^»M^ifi®cAw.iu 24x24 */Jnw& 
siso 000 £>n bp^m boosting im& 

Viola 
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■■ JIQJXUF.XIY L ANLTJIYINGYOMG 

&3IAT“*R#IS”(Integral Image) M#E&. 


A 

B 



1 

2 

C 

D 



3 

4 





a 7-23 

m 7-23 mfrmTGMrt %,d »n>m «( 4 > +«(d - 

ii(2) —K(3)Tf"2£ „ 

ii(x,y) = 2 i(x',y') (7-3) 

x<x .y^y' 

s(x,y ) =s(x»y — 1) +z'(x,j>) 

ii(.x,y ) —iiix — 1 ,y) -hs(x,y) (7-4) 

£+.»Gr,y)^fr«&&»..i.*(as-n=o,u(-,A>=o 0 *—WfflfcW8* 

ftfllJTIR5>I® it * WEt,S, {gvJmtMiM 

,. 2. adaboost 
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% 7 

ti »•* m i‘5] & tn m # jal ,m in hk a sea ± *1 . h aar $ se * je jt # $ m , 

boosting 

£ boosting 

boosting i 

boosting adaboost 3¥j£, & Freund fU Schapire ^ 1995 

Viola AAKItll o Viola adaboostCdis- 

creteadaboos t) £fiH ± M * , *6 f tkk —t * M $£ ft fiE * * & # *1 'J'M 

3t 7-6 ft Viola adaboost M«E@. MM§T, 

^^i±.adaboost ft—ftijll 

0. 5 0 

Viola adaboost, 

^fi^«fiw^af(stum P ). />(*>,fc«ft 

ffite-fflM 0 , - a : 

r i, -i 

/i;(.r)=s 

[ifpjfjCxXpjd j otherwise 


(7-5) 



JIOIXUKXlYUANLIjrViNCrYONO 

m 7-6 Adaboost Jfjfcaftii 


aJi„: =^- ,n A, ft 

im in 

For*=l,-,T(#^*JMfc*) : 

•j3—= v-^' ' - ’'tstffifa'H TV, ”T 

ljj=lWt.j 

w, = X,to, (/i, (x,) #>»,) 

M.%T$-&fa / ftL:iv,+i.i =to,,,(/? v '). 

■&• I 7 »e,., =-j hj(Xj) —y, 

lo. 


hj(xj) ^y t ,/?=t-^— 
i St 

H(x)=i Hl=ictih,(x)^m=\a, 

lo. 


otherwise,-£- 'f 1 


<aj —ylog 


J_ 

A 


i 


3. Cascade 

(cascade)* -fa JnSS W 

ttifi&Mft#*. adaboost 
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$ 7 $/«lS¥3£JIJ3fEMK«r 

50%) „ 



IS 7-24 cascade &] ik ¥j 
bootstrap $m, 

mmirnw*. 

4. boostedcascade 

boostedcascade Wf£—if', 5 lDJ $tt§ 7 it? fS. ftfj ;£ £E • 7i M ft-J ife AM 3C-iS 
fTSf^-^r&iio ff)0t haar , Lienhart MtH W haar , lilll#? 

i&M®iJ^;Levi!0|JM^7 eoh W$E,±Am^T , pTft/MIll 

tt5tf3§##§»,BoWu|idi7*#**#tt 
stump, Iffifl flj 7 #ffi, M, W*{5UW 7 fcM 7 4#JE M 

Mo 

ft'Xt boosting Jf7l£,BoWu JEMtH Tboosting, 
JiaT^^WlEJSliAtXinwenHou boosting 0 £ 

#HEW adaboost ^.jEft^+WMMfflPiw.iafttaEaiisisi+.jE^w 

boosting BliS—^HS^illffliKo 

ff*f cascade ft^^&.StanZ. Li M, L H7-#»7 FloatBoost MgfflM 
FloatBoost ft ^c#£o |b]S 7 adaboost fKjJffcflfi fct»li 
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■■■ nOTVUFXIVl ASJUJlV INCJVOs<. 

gftmARk&mmm' r. x iao ha# cascade^g2Stt±nttiT«2£.ntH 

BoostingChain. 

f@ m ft * , mfemm w^# * M4> w p , 

cascade AWinLjitfcfWife, B. Wu.C. Huang 

(nestedcascade) „ L. Bourdev #f A-& BoostingChain W3S5!li_h:i|j:—cas- 
cade^jfi.H/tjT softcascade. 

soft C ascad e !M^ir^^P^»ttaff-tf^*r,«*^»f?P3t#A3«r 

mm o a»{*£rttts awi#m« 

®fftA8i-j&«o 

5. boostedcascade ^Efr A$&9l!l 4 1 

boos tedcascade ft A"{X.tSi AJ&ItM tyl M Afl^il -/Hf r A^PJ vjl!M, til^b 
flfio #ffi|3fe%,Violaft2003 ¥M,‘HIWl0^«Jt[S|fqiilj)|MS4 , *M haar 
«pfiE,BEttai^AflcW^3KXW»i6AfrWiB?tl. QiangZhu PUJffl hog 
#haar fif/Lft# stump ft 

hog W'iSMifW' hkM'& Dalai 6<J hog ^ ft ^ii frill SSliSjT JL“HrD 

Laptev QiangZhu «&«!&». K»J 

Laptev ^ljjflhog #|iF.|5$*ft,TiJl|£&i£ji§:„ OncelTuzel 

iogitb OOS t 

MTtt hog Ml!fW^.^A^-Mi^^T(fppw=10- 4 ),nTiiSIJ 93% 

3000 P , *5 Dalai M hog WftM Ifll 

KS'Jo 

edgelet #)$Rft 80 £ 

Tf^mt EW edgelet *j£Jfc-/adaboost.S^tt^SStfc* 
«UK^ftW4mSS. ftW-HMS.iia CBT.BoWu Mfljffl edgelet 

Inria«^±jffiBT hoggft&tjfijK. 
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% 7 $/«LV3fc3£Ji3Xffli*#r 

Sabzmeydani HfijlHj shapelet . 

7 boostinguswtffls 

7.4.4 boostedcascade 6$4rA.^i«i 

±—7’^l'^3TS7 boostedcascade 

haar &S 

m , MBS ,Dft up, 1 =£, , 0 JltM#7^£ii 

ffl7ftA*&'»h boosting HE 

&=^-ffixt£imWBfe&. #4#tEi£&±.SMniliil7 hogWfiEWflffftJK* 

shog(simplehog) shog #fiE^ haar 1#{D;iBn‘^5|5f^ffl. 

hogwm®m&mmm,xmfflRi haarij«Ejsfii&#iM. & boosting# 

fe±.SMn#fli7£fll adaboost adaboost,RMM^^^±tfef'Jffl 

7#fiE„ 

4§i^^±.^fn^iii75feffl*ntxw fisher mmftmmM&m-trfa, 

}E£*t M shog wm* *-*t,MS^*(lookuptable)ia^^, AAM7 

illlSKHt fil, «W7^#W«aE. 

= Inrta *«*±«£lfe 

*531. 

l. 4#fiEM&& 

ftilflr—Dalai nmW hog«pfiHftfrAlft«l±W 
Ot^^a. M Dalai 

M Da¬ 
lai M£tft,4n£$3Kffl>mai 4000 1 IfrtoisfTiftrai. 

2Ja QiangZhu # hog &ft7 haar #tiE,*lJ 
m boostedcascade AAM?K ffl.Ji&#MSMA 

SSIJ BoWu i|$ haar edgelet 

ffttitfctt haar hog ffi&mfalltfi# hog ftffiffiffc* 

shog #|ni,#^Tt^M^fS;7 75%„ 
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■Hi /IOIXIJEX IYUANLI JI'YINGYONG 

hog sift 4#!iE.Dalai A»». illA 

sift 2X2 >NMg!R? &Ji03j Lowe 

vi mm [pjmjwi & w nm . wt m * 

mm, m2x2mifrfefe&m^EMzmmjTmftM 3 i L ffio &mtos& 

T:2X2 Wftl^-^S'&fTAftJUBi? BE& boosting HC&flrOJDMF^^fiEW 

mmmm®m& innaM^ajn 

2416 !K 32X64 2416 &.JA 1218 

bootstrap 

realadaboost HAST fisher 
haar ft shog ftjffi&.iPffl 7-25. 





JA® 7-25 ,«A^-W«m^T(f P pw=io- 4 ) 

ffl haar «pfiEW»»45* 77%,£$cAT hog Wi^SIJT 86%;$P 

uMim shog mt hog w ts, ft in p<j & m m » m 11 ® sh og 

ho g w i/ 4 ,im«rtiii&i£* 2 fg^iisn 
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$ 7 

A 30%„ 1. 8 GHz CPU haar f[I shog 

6 640X480 tfj TOIO W' 2 M, tk 

Dalai 4000 PtfcTifi 15 fgf. 

2. boosting Stiff 

£ltii}7 discreteadaboost ~Z.fa ,Schapire 5£{it adaboost (real- 

adaboost) o adaboost adaboost 

{-i.i}, w»«, na*pm w 

^ 7 - 6 ^ 

Schapir realadaboost 

*(x ) - 1 og(^_"lJ-j r ] ) ) (7-6) 

BoWu W«^(look-uptable) 0 ®£JPT: 

VXe Bin ih(x) =\ln( W L l + e ) (7-7) 

L \Wj i6' 

£4W JA® 

tSiSL.iiji-^^aaifc.fp stump 7-26 

ilfljfflWfaE, ££ Booting ^VimW'E'Pbm 

fiE&fJfc£Mtfc#4s. 



® 7-26 Stumps BoWuH.AWi^.lLWK*'] 

«l^fn tfc^T discreteadaboost -fej realadaboost 
M±WS1tS'Jffl®±W^5'Jo SfnffiMW«?fiE‘»Jihog!KFfiE. *t7dis- 
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■■■ JMjlXUFXlYU \.V1(JIV1 NIjV0N0 

creteadaboosl.^cfnffiM stump realadaboost, 


tt4£boostingJ£j& 



IS 7-27 boosting $->£:&] *t.£L 


ft® 7-27 4>,^fnnrW#PJft^ffl7$ft adaboost J£** 

Mi^o . realadaboost discreteadaboost 

M7 5%„ 7-28 t.^n^»!litti7 

MM# boostingJTfeTll|^di*W#l«^«»WtirHaJ9fffifflW4#fiE. 

M^{S boosting 7 7 7' hog 4#fiE, boosting 

iJl|^MM^»Jf®M7 14 tfcflJ##f7«E«E—f&. * 7%® boos¬ 

ting 



S 7-28 -2-M 
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*8 7 


£ffl4>WJ6Wil:boostingili|^iliW4m#. 

3. boosting 
(i) 

£±ffiMT^.$fnaraT realadaboost MR shog ffiJi 

ii^t. ; 1 1 1 ii W—^^!8fi- (Lj I' 1 '] H5: realadaboost Ti H X*t W' fi$ iH -fib' H‘. rSrifc 

sho g <$& 

w^zMA-mt sh 0g 

Qiangzhu fi * « wfa mrnmm 

I'sJit-fcc.QiangZhu *#*&£«& 200 hog «MSE2fcfirill|&; Laptev Hffl 

fflffliUtttt fisher hog 

stumpy. 

,a=- 7 -Wi 

nll-Wi 
1 = 1 

S=-i-r—Ew?(/ ; -/u)</,-^) T 

(n — l)Sio;' 1 

;=l 

w = (S + +S-)-'(^ + -^-) (7-8) 

M.w, ftfSi #J#fiF.fai:,, ft JiJjn 

u foxwm -, s + m s- muu wmm®. &, w m&&u isj. 

Laptev 


a»*BWite 
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■■ IKJIXlJLXI YLASL IJITINCVOXC 

M 7-29 4>.wfld+lut \m9tmm fisher 
wfld+stump ^7Kfi:Sstump fl&JjSj* linearsvm svm 

Biuxmminto&ih 

$!l>^ 86%,M wfld+stump ffaTriiA 81 %,linearsvm 82%(3^^^F. 

QiangZhu Wife**.ft 

3~4 a„ fisher s 

(2) /MS 

$Cl& boostedeascade fitjflflj7ftAfcW *,i¥tt7&#ft|iF.Mft'tt, H 
Hi 7 hog shbg,#)Kf hog haar 

^,XB^^haar#ffiji7f^-¥-,W)t^^M^li. 

MM' fisher W3jM£dl%^ hog«ffiE«fli*-S|.3pJfflattt*ttP^#» 
realadaboost discreteadaboost, SEfU'HiTtf'^, XHi^ 714 

1 

Drift#*. 


2010,22(9): 1619-1627. 
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% 7 ¥/m§S3£3J£ffl3fitt*l#T 

m gij m .sp m . min^^gft 

. 3ti3$£( Radial Basis Functions,RBF))tf|=r7:Pir^'ffl[^rt??fn : '|N|F]Jxl i f ; ftfrtIi£3tl 
nTK»5J4-A#l*Wa*. 2001 ^ Rose RBF 

tfc$S!tt3£. & HiiJBT/HfiHiasfr. * iS . 

Torresani «0iI7-7* 

Wang 

Mukai 

I'B] 4 1 ii 6'J ffi] ^fflMitf: (Geostatistic) 

ilsafTfBfftffittfl:. Cooper 

3iisa!£1H#M2rife. 

Cooper 

lkemcfto«tfi7-* > MMI 

z5&£±..(in[U 7-30 7 (Gaussian Processes,GP) ,t: 

i5 RBF-#«p*-#*T«WliIJB^rS. 
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| IIQIXtltMVltANI.imr rNC.VONG 

JM Jll 

a 7-30 tiLJQ GP 

Brand 

(Hidden Markov Model,HMMJXtfcffijsSb&fr&g 

»#».^50WMftBTfflT^rit»flliSSll. Li 
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